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SIMULATING SEVERE WEATHER 
by Louis J. Wicker 

Simulating severe storms and tornadoes takes lots of computer power. Louis examines severe weather 
simulation, starting with equations for turbulence and ending with Fortran source code. 
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HIERARCHICAL LOGIC SIMULATION 

by Donald C. Craig 

Donald presents an approach by which hardware components can be represented and simulated 
hierarchically using C++. His simulation strategy is completely asynchronous, meaning that the concept of 
global time has been abandoned in favor of each component maintaining its own concept of local time. 





THE JAVA PROVIDER ARCHITECTURE 40 
by Paul Tremblett 

Paul uses the JDK’s Java Cryptography Extension to implement a cipher algorithm that simulates the 
Enigma machine made famous by Germany in World War II. 


WOOKIE: A 68HC11 EMULATOR 50 
by Kalle Anderson, Jason Buttron, Paul Clarke, and Matt Enwald 

WOOKIE, short for the “Wireless Object-Oriented Kindly Interfaced Emulator,” is a Win32 emulator for 
68HC11-based software development. Our authors discuss both its development and use. Wilbert 
Bilderbeek, Harry Broeders, and Alex van Rooijen then introduce the THRSim11 68HC11 simulator which 





they designed and built. 

THE WINDOWS CE EMULATOR 56 

by Aspi Havewala LRA SN 
The Windows CE SDK includes a functional emulation shell that mimics a Windows CE Handheld PC Three-dimensional rendering of a simulation of a special 


class of tornado temperature (blue for colder air), the 
white/gray isosurface that spans the domain is the 
thunderstorm clouds. The yellow tubular isosurfaces 
represent the model equivalent of landspouts, a weak 
tornado vortex associated with developing thunderstorms 
along the front range of the Rocky Mountains during late 
spring and summer. Courtesy of Dr. Bruce Lee, Northern 
Colorado University. 


(HPC) shell. This emulation environment makes it possible for you to jumpstart development by 
prototyping applications. 


EMBEDDED SYSTEMS 


LOW-LEVEL APIS FOR EMBEDDED SYSTEMS 0 
by Tom Cunningham and Chad Peckham 

While desktop APIs address desktop-oriented issues such as window manipulation, process 
management, and file/database access, APIs for embedded and real-time systems tackle debugger 
interfacing, task management, low-level device I/O, and the like. Tom and Chad examine a pair of 
APIs that are typical of low-level programming interfaces in embedded environments. 


INTERNET PROGRAMMING 


UNDERSTANDING LDAP UWB 
by Basit Hussain 

LDAP, short for “Lightweight Directory Assistance Protocol,” provides a platform-independent 
mechanism for searching, storing, and replicating information. Basit examines LDAP and presents 
examples of how you can use it. 
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COMPILER CONSTRUCTION WITH ANTLR AND JAVA §4 


by Gary L. Schaps 

ANTIR, short for “Another Tool for Language Recognition,” is a language tool that 
gives you a framework for constructing recognizers, compilers, and translators for C, 
C++, and Java. 


CONTROLLING MOTION-TRACKING DEVICES 90 
by Mike Harrington 

Motion-tracking devices, which report on an object’s position and/or orientation in 
real time as it moves, are necessary to navigate 3D simulated worlds. 


COLUMNS 


PROGRAMMING PARADIGMS 99 
by Michael Swaine 

Nanotechnology is a big deal in Michael’s mind this month. 

C PROGRAMMING 103 
by Al Stevens 


Al puts Quincy 99 and D-Flat 2000 on hold as he continues his discussion of 
Standard C++. 


JAVA Q&A 107 
by Andrew Wilson 

How do you implement Microsoft’s delegate keyword? Andrew presents classes 

that mimic the delegate keyword, letting you build a complex user interface with 
simpler event-handling code. 


ALGORITHM ALLEY 115 
by Tim Kientzle 

The Discrete Cosine Transform (DCT) is a crucial part of modern image and sound 
compression. Tim discusses several fast algorithms for computing the 8-point DCT 
and IDCT. 


DR. ECCO’S OMNIHEURIST CORNER 121 
by Dennis E. Shasha 

Ecco and crew look for the most efficient way to mix trains, stations, 

and passengers. 


PROGRAMMER’S BOOKSHELF 125 
by Jonathan Amsterdam 

Jonathan catches up on Dennis Shasha and Cathy Lazere’s Out of Their Minds, and 
Peter G. Neumann’s Computer-Related Risks. 
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April means algorithms, as we examine 

everything from regular expressions and 
decision trees, to algorithm design and 

analysis. 
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Real-world data management solutions 
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examines the pieces, than initially 
recognized by the majority of database 
programers. All software projects are 
complex puzzles comprised of many 
details, most of which are data-related. 
Often today’s “DBMS” solutions sacrifice 
the speed or control essential for a 
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workstations, c-tree Plus’s small footprint 
and exceptional performance have also made 
it the engine of choice for professional 
developers on Windows and Mac. c-tree Plus 
offers sophisticated ISAM level control with 
which the developer may define precise data 
flexibility and control at the detail level to fit | management solutions, making it a perfect 


fit for any development project requiring 
specific data handling features. 
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EDITORIAL 


airport lounges. Around here, we’ve grown used to Greyhound and Burger King. And while 


rom what I hear, editors at other magazines fly first class and hang out at exclusive members-only 
Bumper Cars At F 


Mach | 


other editors brag about frequent-flyer upgrades, we've learned to appreciate bus transfers. 

Hankering to find out how the other half travels, DD/ technical editor Eugene Kim and I 
recently decided to try the next best thing — simulation. Frankly, what we had in mind was 
something along the lines of the Concorde, with gourmet meals, hovering flight attendants, and 
in-flight movies — all at a simulated 30,000 feet. What we ended up with was, well, a bit more. 
You might say that we bit off more than we could flew. 

For starters, flight simulators aren’t as easy to find as, say, a Starbucks. Not to be deterred, we 
set out from DDJ world headquarters in search of a simulator, ending up in Mountain View, 
California, home to Sun Microsystems, NASA Ames Research Center, Kim’s Restaurant (no relation 
to Eugene), and, as luck would have it, Fightertown USA. 

Fightertown USA (http://www.fightertown.com/) is a jet aircraft simulation center that lets any 
schmuck off the street “fly” an F-14 Tomcat, F-16 Falcon, F-111 Aardvark, F-18 Hornet, and the 
like. All in all, Fightertown offers 23 interactive simulators, each with fully functional avionics 
panels, heads-up/heads-down displays, and hands-on stick and throttle controls. You and your 
buddies (up to 10 aircraft can be linked in the same virtual world) can take on one or more 
computer- generated opponents, take out oil rigs or bridges, and night-land on aircraft carriers. 

The simulators run on 450-MHz Pentium II PCs linked to a hub computer through a custom 
network provided by AeroNumerics (http://www.aeronumerics.com/). Fightertown uses the Obsidian 
X-24 3D accelerator card from Quantum3D Chttp://www.quantum3d.com/) for the heads-up “out the 
window” display, and the ATI 3D Rage (http://www.atitech.ca/) for the 2D heads-down “in the 
cockpit” display. Some of the cockpits use LCD projectors, while others use a 27-inch VGA monitor 
for the heads-up display. They also use the Diamond Monster MX200 sound card (http://www 
.diamondmm.com/), with two speaker sets, for 3D sound acceleration. 

The heads-down display replicates the basic systems found on jet fighters — radar, moving 
map, fuel, airspeed, weapons, aircraft configuration, and the like. The cockpit (and they are real 
honest-to-gosh jet cockpits) is linked to the computer through the serial port (also provided by 
AeroNumerics) for feedback from the flight controls and switch panels, and all the cockpits are 
linked together through a custom voice communications network for interaction between pilot-to- 
pilot, and pilot-to-control tower. 

On the software side, the simulation system, which is written in C++, runs under Windows 98. The 
graphics engine is based on the Glide optimized rasterization library from 3Dfx Interactive 
(http://www.3dfx.com/). The effects— islands, airports, aircraft carriers, multiple aircraft, and targets 
of opportunity (oil rigs, ships, bridges, and the like)— are stored in a big 3D image database. 

What Eugene and I ended up in was a dual-seat F-111 Aardvark that had a wall-size projection 
view out the cockpit window. (Eugene thought that the two of us flying side-by-side in the same 
cockpit would be a good team-building exercise. I reminded him that something similar probably 
occurred to Laurel and Hardy early in their career.) Since this was our first flight, we operated in “jet 
trainer” mode, which meant we couldn’t go as fast as experienced top guns who fly in “fighter attack” 
mode. And since it’s all software, our Aardvark cockpit was programmed to react like a Tomcat. 

For the most part, our 30-minute flight consisted of take-offs and landings on both airfields 
and aircraft carriers. During the entire flight, we could talk to each other and the control tower 
over helmet-mounted radios. (Befitting a youth spent in front of video games, not to mention an 
Ivy League education, Eugene was more adept at touch-and-goes than me.) Although we took 
turns flying the plane— that is, controlling the altitude, airspeed, and direction—Eugene was in 
charge of raising and lowering the flaps, landing gear, and tailhook. And when the control tower 
armed our plane with missiles and bombs, we also took turns attacking enemy sites. 

Although the graphics weren't photorealistic, they were more than good enough for us to really 
get into the simulation. When making a high-speed, low-level (under 1000 feet) run up a river with 
Eugene at the stick, my stomach really did do a flip-flop or two. Communication with the tower was 
somewhat scratchy, making it difficult to pick up on suggestions and instructions. Foot-rudder 
control hadn’t been implemented yet on the plane we flew, but will be shortly, said our flight 
instructor. Fightertown’s goal, he said, was for simulation to be “90 percent” of the real deal. 

What we came away with was a profound respect for fighter pilots. There’s a lot of stuff going 
on in the cockpit, requiring knowledge, coordination, and instinct. We also walked away with 
respect for what the programmers at Fightertown have done. The simulations are intense and fun, 
and that they are available to the public is pretty amazing. Roger-dodger. Over and out. 


ee 


Jonathan Erickson 
editor-in-chief 
jerickson@ddj.com 
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LETTERS 








There’s Always Room for Forth 
Dear DD, 

I enjoyed seeing the coverage of Forth in 
John Sadler’s “FICL: An Embeddable Ex- 
tension Language Interpreter” (DDJ, Jan- 
uary 1999). Forth is a solution to many 
development problems. For instance, 
here’s a real-world precedent for Forth- 
like embedded interpreters. 

At Jet Propulsion Laboratory (JPL), we 
embedded a Forth interpreter in a large 
military simulation back in the mid 1980s. 
The simulation and the interpreter are still 
in use; the Corps Battle Simulation (CBS) 
supports military training exercises at sites 
throughout the world, and is still main- 
tained by a small team at JPL. 

We use Forth not only as an embedded 
interactive scripting language, but also as 
a symbolic debugger. Of course, debug- 
gers have come a long way in the past 15 
years, but we still find ourselves using 
Forth commands on an alphanumeric ter- 
minal to examine and change variables 
while several hundred users are interact- 
ing with the simulation. 

One more technical note: Our simula- 
tion and the interpreter are written in Sim- 
script II.5, a simulation programming lan- 
guage marketed by CACTI. Simscript turned 
out to be a great tool for writing inter- 
preters in addition to simulations. Nowa- 
days, the product has its own symbolic 
debugger, but it looks nothing like Forth. 

Jay Braun 

braun@solstice.jpl.nasa.gov/ 


Online Op/Eds 

Dear DDJ, 

I enjoyed S. Balamurugans’ online Op/Ed 
“Why Is There a CPAN but No CCAN?” on 
the DD] web site (http://www.ddj.com/), 
which asked (and answered) the question 
of why we have a Comprehensive Perl 
Archives Network (CPAN) but not a Com- 
prehensive C/C++ Archives Network 
(CCAN). By coincidence this is a concern 
of mine as well. I have, in fact, been plac- 
ing C++ source code onto my web site. 
By the first of the year I expect the amount 
of source code to grow considerably. The 
site right now is rather dull looking but is 
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at http://www .frontiernet.net/~guffy/source. 
If at all possible I would like to pass this 
web site on to other readers. The source 
code there is free for download and I look 
for contributions from others. 

David Cox 

euffy @frontiernet.net 


Parsing Expressions in Java 
Dear DDJ, 
Upon reading Cliff Berg’s article “Parsing 
Expression in Java” (DDJ, January 1999), 
I was surprised that he didn’t mention 
more powerful tools than the bare tok- 
enizer functionalities offered by the Java 
API. In particular, I refer to tools that im- 
plement context-free parser like yacc, 
which are now available in Java; for ex- 
ample, JavaCup, Antlr (http://www.antlr 
.org/), and JavaCC (http://www.suntest 
.com/JavaCC/index.html). 
Christophe Ponsard 
chp@info.ucl.ac.be 


DD] replies: Thanks for your note, 
Christophe. You're right, there are some 
very powerful Java parsing tools out there 
that deserve coverage. That’s why we 
hope you enjoy Gary Schap’s article “Com- 
piler Construction with Antlr and Java” on 
page 84 of this issue. 


Age Discrimination 

Dear DD], 

I read Jonathan Erickson’s December 1998 
“Editorial” on the H-1B visa issue. He was 
spot on. I volunteer with a group called 
“ProMatch” here in Silicon Valley. It is a 
no-fee professional career resource cen- 
ter. Most of its members, and there are an 
average of 100—200 at any given time, are 
senior people with many years of experi- 
ence in a variety of positions. The thing I 
note most often is that their former em- 
ployers make no attempt to retrain the 
staff they are laying off. Besides leading 
to the bizarre situation of companies lay- 
ing off people in one area and hiring in 
another, it is very bad business manage- 
ment. Letting experienced people go 
means that part of the corporate memory 
and culture disappears, experience and 
more efficient ways of doing things are 
lost, morale plummets, recruitment takes 
lots of time and money, recruitment also 
extends the crucial time-to-market win- 
dow, and integration of new staff into the 
company’s culture also is time consum- 
ing. This is balanced against lower initial 
salaries a more malleable work force, and 
a more narrowly defined skill set. As a last 
point, well respected companies like HP, 
which have large numbers of temporary 
staff, tend to keep these people for many 
years. The cost of staff turmoil is not worth 
it in the long run and one way to reduce 


this turmoil is with retraining. Thus, the 

need for tens of thousands of foreign work- 

ers is far less than some businesses claim. 
Reg Charney 
charney@CharneyDay.com 


A Better Date? 

Dear DDJ, 

Suppose I have to construct a system for 
storing dates. I decide to store the dates 
in a standard, straightforward MM/DD/YY 
format using digits. Never mind about bi- 
nary numbers and the like, let them come 
later. Dates are allowed to range from 
01/01/00 to 12/31/99. These ranges mean 
I am able to store all the dates of one cen- 
tury. About 37,000 dates. 

This is where I thought: Wait a minute, 
something is wrong here— six digits. 
Shouldn’t that be 1,000,000 dates. Where 
does the other 963,000 dates hide? 

The answer comes fast. MM/DD. This 
way of storing dates is very inefficient. Glad- 
ly, the solution comes just as fast. Here is 
mine: To be able to represent 23 more cen- 
turies, I allow dates to range from 01/01/00 
to 96/93/99 in the following manner: 


e century(1,1) range from 01/01/00 to 
12/31/99. 

e century(2,1) range from 13/01/00 to 
24/31/99. 


¢ century(8,1) range from 85/01/00 to 
96/31/99. 

¢ century(1,2) range from 01/32/00 to 
12/63/99. 

e century(1,3) range from 01/64/00 to 
12/99/99. 


For example: 


e century(5,2) range from 49/32/00 to 
60/63/99 


This system makes it possible to repre- 
sent in whole 24 (8x3) centuries, approxi- 
mately 888,000 dates. It is not all of the pos- 
sible combinations, but it is much better. 

Now, as I see it, this system is far bet- 
ter than any of the systems I saw in the 
last journal. It is simple to understand. It 
should be possible to use it in all databas- 
es that stores dates in an MM/DD/YY 
form. It does not require any changes in 
such existing databases, and it is fully 
backward compatible. A date in the nor- 
mal MM/DD/YY form will be the exact 
same date in the aforementioned system. 

Torkel Danielsson 

torkel.danielsson@mindless.com/ 


Dear DDJ, 

I was wondering the other day why no- 
body hasn’t come up with a more exten- 
sive way to represent hexadecimal. There 
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e Fully integrated with the Visual C++ 6.0 IDE 


e Reverse engineers ATL/MFC 
° Microsoft® Visual SourceSafe™ Integration 


e Instantly updates UML diagrams based on code changes 


© Model your software with UML Class, Use Case and 
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e Automatic Roundtrip Engineering - 
¢ Shows relationships to MFC, ATL and Stingray class libraries 


a — | i 800-924-4223 
919-461-06/2 _—_. 
sales@stingray.com 


www.STINGRAY.com 
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(continued from page 10) 

are more letters in the alphabet than “F.” 
So, if the hexadecimal we all know about 
is based on representing 16 different val- 
ues, than why don’t we have one that rep- 
resents 32 values? Simple enough? Hex- 
adecimal is, of course, based on the range 
of 0 to F so a 32 value representation, 
double hex, for lack of a better word, 
could be from 0 to V. 

This could also be used as a Y2K fix. 
I'll explain: If you have the last date of 
the millennium in the legacy format of 
YYMMDD,, it looks like this : 991231. Use 
“double hex” and the same date in the 
format of YYYYMD could be represent- 
ed as 1999CV. The month would be a 
“double hex,” or even hexadecimal would 
do, and the day would be a “double hex” 
also. Amazingly enough, the maximum 
single digit value of “double hex” is 31, 
the maximum amount of days in a month. 

The basic thinking is: Instead of com- 
pressing the year like many other Y2K 
schemes, why not compress the month 
and day? After all, there’s a finite amount 
of months in a year (12) and a finite 
amount of days in a month (28,29,30, and 
31) But the years are infinite (0 to ?). The 
best part is that a date could still remain 
“human readable” with no complicated 
math involved and a simple knowledge 


Self-Paced Training for Develo 


KeyStone Learning Systems Corp.” 


Paul D. Sheriff 
Microsoft Certified 
& Visual Basic Instructor 


of “double hex” is all that would be nec- 
essary. You know how to read hex? Then 
just extend the hex table to twice its cur- 
rent size and there you have it. Shouldn't 
be that hard to learn. 

Of course, “double hex” could have oth- 
er applications, but Y2K seemed a good 
example of how to use it. Just a thought. 

Christian Lanctot 

clanctot@sota.com 


More Y2K 

Dear DDJ, 

In the May 1998 issue of your journal there 
were two articles about the Y2K problem. 
“Date Compression and Year 2000 Chal- 
lenges” by R.L. Moore and D.G. Foley and 
“Strategies for Solving the Y2K Problem” 
by W.Gothard and L. Rodner. Both articles 
were very interesting and got me thinking. 

The problem of Cobol records with 
MMDDYy dates to be expanded to MMD- 
DYYYY is a tremendous task since to con- 
vert millions if not billions of old records 
by 2 bytes would take enormous amounts 
of storage space. 

My thought is to convert from MMD- 
DYY to DDDYYY with DDD as the day 
of the year and YYY as the year from 
1800. This does not require additional stor- 
age space since both strings are the same 


length. I am sure that assembler routines: 


Robert MacHale 
Professional Trainer 
& Internet Instructor 


can be written to convert both to the 
month, day, and year format. 

Yes, there is the problem of finding the 
usage and changing the code to handle 
the new format but “Date _Born” and 
“Date_Now”, ”Date_Died”, and so on 
would just be a subtraction till the year 
2800 unless you need to manipulate data 
prior to 1800. 

Because my Cobol is a little rusty, I 
realize this is probably simplistic, but it 
does solve the record expansion prob- 
lem that is such a big headache with old- 
er Cobol data. | 

John D. Kent 

tenka74@buffnet.net 


It’s a Cult Kind of Thing 
Dear DDJ, 
After reading Jonathan Erickson’s Novem- 
ber 1998 “Editorial,” I'd like to point out 
that I’ve called myself “Chief Programmer, 
Church of Cybernetics Certainty” for years. 
My church’s goal is not so much enlight- 
enment as tax-free programming income. 
I suggest that Baba-Rom Jon can have 
those followers looking for spiritual lead- 
ership; I’ll take those looking to get rich. 
Steve Furlong, CP, CoCC 
furlos@rpi.edu 
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EADIng Technology in imaging Development Toolkits. 





IMAGE FILE FORMATS 
[One of 16 technology categories) 
JPEG CMP 

-Lossy BMP 
-Lossless OS/2 BMP 
DICOM AWD 
FPX WMF 
EXF EMF 
PSD WPG 
PCD AV| 
EPS MSP 
{OCA TIFF 6.0 
MODCA -Multipage 
CAL -JPEG 
ICO -Packbits 
SUR -Huffman 
CX -RLE 
JICX -LZW 
MG -CCITT 
JIB -CCITT G31D 
RAW FAX -CCITT G32D 
NFX -CCITT G4 
MAC -RGB 
J/DA -Palletized 
SIF -Grayscale 
°NG -Bitonal 
[GA -CMYK 
RAS -YCbCr 
PCT -CIELAB 


LEADTOOLS is the driving engine of choice. 


The leaders in software development choose award-winning 
LEADTOOLS imaging technology - companies like Microsoft, Hewlett 
Boeing, Xerox and thousands of others use 
LEADTOOLS in their high volume applications and internal systems. 
Why? LEADTOOLS gives developers the most flexible and powerful, 
imaging technology available. LEADTOOLS offers 16 areas of imaging 
technology, and makes it easy to add still frame, multimedia, document 
and medical imaging into applications by offering the choice of three 
application programmer interfaces: A low level API, a C++ class library 
and easy to use ActiveX controls. The AP! allows you to make low level 
DLL calls. With LEADTOOL's new C++ class library you get the control 
of low-level access and the ease of object oriented programming. Need 
development speed? With ActiveX controls you can develop at break 
neck speed using RAD components. All LEADTOOLS toolkits allow 
you to cut and paste from hundreds of ready-made source code 
You won't find another toolkit on the market containing 
more imaging technology or easier to use than LEADTOOLS. 


Packard, Intel, 


examples. 


Gis). 


Activex 


EADTOOLS Supplies you with the Power to Integrate 16 areas of Imaging Technology 


IMAGE PROCESSING 
TRANSFORMS 


ncluding resize, resample 
interpolated resize), rotate 
.01 degree), flip, invert, 
everse, crop, underlay, 
‘hear, transpose, stretch 
itensity, fill, auto deskew 
ind combine (with mathe- 
natical and Boolean opera- 
ons). 


FILTERS 


ncluding sharpen, blur, 
iverage, edge detect, line 
etect, emboss, mosaic, 
iosterize, median and noise 
lters, spatial filter (which can 
‘e pre-defined such as 
radient, laplacian, sobel, 
rewitt, shift and difference, 
ne segment, or they can be 
ustomized), and more. 


DRAWING 


Jraw directly to a bitmap 
sing windows GDI (such as 
extOut, BitBit, Ellipse, and 
‘ectangle), or use the 
\ctiveX built-in drawing 
rethods. 


REGION OF INTEREST 


*rocess only a_ specific 
iortion of an image rather 
han the entire bitmap. 
<egions can be comprised of 
iny combination of rectan- 
jles, ellipses, rounded- 
ectangles, freehand shapes, 
olygons, transparent color 
ind more. 


ISIS®, and TWAIN with 16 and 32 bit native 
mode and buffered RAM transfer modes. 


COLOR CONVERSION 


Depth conversion - 1 to 32 bit with 8 dithering 
methods. Color space conversion/separation - 
RGB, YUV, CMYK, CMY, YIQ, HSV & HLS. 
Grayscaling, brighten, darken, invert, hue and 
saturation, contrast, gamma correction, and 
histogram equalize. 


DISPLAY/SPECIAL EFFECTS 


LEADTOOLS provides optimized rendering of 
any image to all display devices with monitor 
calibrations, auto-dithering, stretching, panning, 
zooming, scrolling, and animation. Choose from 
2018 paint effects, 36 gradients, 80 shapes, 12 
3D text styles, 64 dissolves and 43 transition 
effects, with delays, grain sizes, pattern brushes 
and acolored wand. 


ANNOTATIONS 


For documents or color images more than 17 
different objects, all with security passwords and 
hyperlinks. 


COMPRESSION 


Industry standard methods such as JPEG, PNG, 
Exif and CCITT G3/G4 as well as industry 
leading proprietary LEAD CMP. 


IMAGING COMMON DIALOG 


LEAD's unique common dialog customized for 
imaging, saves time and provides a consistent 
and professional interface. 


INTERNET/INTRANET 


LEADTOOLS features Net Aware ActiveX with 
ASP support and a Netscape plug-in. Load 
images from any URL. Support for Progressive 
JPEG / CMP, and special GIF* flavors (interlace, 
transparency, animation, and text). 


DATABASE 


LEADTOOLS has specific features designed for 
the imaging database developer: VB data 
binding, 32-bit ODBC, OLE DB, a customized 
OLE 2.0 in-place server, Load/Save memory, 
and Load/Save file offset. 


Uses Xerox® TextBridge® recognition 
technology. Fonts recognized within the same 
image, callback functions for user input while 
processing, training OCR engine for improved 
recognition and multi-language support. 


SCREEN CAPTURE 


Capture entire screen, active window, selected 
menu, menu under cursor, selected window 
object (button, tool bar, icon, or client area), 
selected area (rectangle, rounded rectangle, 
ellipse, polygon or freehand) and resources 
stored in EXEs or DLLs. Options include multi- 
capture with callback, Hot Keys, and time 
interval. 


PRINTING 


LEADTOOLS performs all image processing 
necessary to print directly to any Windows 
supported printer, with the ability to print text and 
multiple images on the same page. 


MULTIMEDIA 


VIDEO: Play/edit multimedia objects. 
Play/Stop/Pause, set balance, volume, play rate 
and time format. Edit existing multimedia 
objects, or create new ones. Copy, delete, 
insert, paste, replace frames. AVI, MPEG1, 
MIDI, WAV and more are supported. CAPTURE: 
Audio/ video. Streaming with frame rate, single 
frame, audio, (volume, level, formats, and 
muting) and device selection. INTERNET: 
Create video, audio and data client server 
applications including video conferencing over 
the Internet/intranet. 


ADTOOLS is available in several versions, not all features are available in all versions. *License required from Unisys for formats using LZW compression. LEAD and LEADTOOLS are registered trademarks of LEAD 
hnologies, Inc. TextBridge® is a registered trademark of the Xerox Corporation. ISIS® is a registered trademark of Pixel Translations, a division of Input Software, Inc. All other product names are trademarks of their respective owners. 
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Comprehensive support for DICOM (spec. 3.0), 
all modalities, including 9-16 bit grayscale image 
processing and display with window leveling. 


FLASHPIX 


Supports viewing transformations, non-image 
data, thumbnails, and load and save portions of 
the image. 


LEADTOOLS 


Supports both 16 and 32-bit development 
environments, and ships with sample source 
code for Visual Basic, C/C++, Visual C++ (MFC), 
C++ Builder, Visual J++, Visual FoxPro, Access, 
Delphi, and VB and Java script. And NEW 
support for Visual Studio database connectivity 
using OLE DB (JET, ODBC, Oracle and SQL 
Server) 
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Picks! 


_ SPF/Sourcekdit v.2.5 
_ by Command Technology 


SPF/SE provides ISPF style file 
____ Management and editing for 

Win-95/98 and WinNT 4.x+ ISPF/PDF 
command set, source colorization, 
ASCII or EBCDIC character set, 
Variable or Fixed records, record 
lengths to 64K, file sizes to 100M, 

_ Hex display/modify, Mappable keys, 
“C" macro language, Dialogue 

__ Definition Language, and much more... 
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C29 0310-EN 
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p DevTrack } 


DevTrack™ 3.0 
by TechExcel 
 DevTrack is the premier defect- and 
project-tracking tool designed specifically 
r software development teams. DevT rack 
_ comprehensively tracks and manages all 

_ defect information, feature requests, 
and development issues. Intuitive and 
powerful, DevTrack provides an integrated 
client/server and intranet/Internet solution 
for enterprise project management. 
Devirack features universal ODBC support, 
icrosoft Visual SourceSafe integration, 
a scalable client/server architecture, 
vanced e-mail notification, built-in time 
tracking, extensive customization, and 
sentation-quality reports and graphics. 
(Formerly PowerTrack.) 
Paradise No. 
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installation 
Suites 
by Wise Solutions 


Wise Solutions 
introduces a new 
generation of versatile installation suites for a wide range of 
developer needs with new features and enhancements that 
make installation scripting, patching, repackaging, and Web 
deployment a snap. Each new Wise product includes version 7.0 
of the award-winning Wise Installation System® with Installation 
Expert, which lets you point-and-click your way to an installation 
in a few easy steps. 





InstallMaster InstallBuilder InstallMaker 
Paradise No. Paradise No. Paradise No. 
G10 0710-EN G10 0610-EN G10 0910-EN 
7125.” *%359.% $175." 
Visual SlickEdit 


by MicroEdge, Inc. 


Visual Slickedit® v4.0, the award- 
winning editor from MicroEdge, Inc. 
increases development productivity, 
and improves software quality. It 
supports most languages out of the 
box and is extendible to support your 
favorite language as well. 


Powerful features include: Context Tagging”, Dynamic 
Difference Editing”, FIP Support, A Class Browser, Dynamic 
Tagging and a Code Beautifier! With a multi-platform presence 
and integration with industry leading 
development environments, Visual 
SlickEdit provides an entire organization 
with a standard coding environment. 


Paradise No. 
M39 0130-EN 
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c-tree Plus® 

by FairCom 

DOS ¢ WINDOWS e NT e UNIX @ 
OS/2 © SUN © RS6000 ¢ HP9000 
MAC © ONX @ LINUX @ SCO. 
This well known, highly-portable 
data management package has 
become established as the tool of 
choice for commercial development. 
Offering unprecedented data 
control, choose from direct low 
level access, ISAM level, or ODBC 
access with the FairCom Server. 
Single User, Multi User, or optional 
Client/Server, ANSI Standard. 

Full Source. No Royalties. 


Supports 25 0/S! 
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True DBGrid Pro 6.0 
by APEX Software Corp. 


The World’s Most Popular 
Grid just got better... Again! 


New 6.0 features include: Native 
support for ADO and OLE DB (including 
master-detail and hierarchical data 
sources); Multi-column sorting with an 
enhanced XArray object; OLE drag and drop; Merge 
cells; Full support for IE and ActiveX compatible browsers; 
Export to HTML; Enhanced styles for displaying in-cell graphics 
(including background and transparent bitmaps); Formatted 
preview and printing; Cell editing interface for 
external ActiveX controls; Push-button cells; 
Customizable headers, footers, and 

record selectors; and much more! 
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TestTrack 
by Seapine Software 


TestIrack is the fastest and vil 
most complete multi-user bug | hbiid de A 
tracking solution for Windows 

95/NT. Tracks bug and feature 

requests, customers, users, 

test configurations, and more. 

Advanced features include e-mail 
notifications, e-mail bug import, duplicate bug 
handling, release note generation, and much more. 
Distribute TestIrack’s standalone bug reporter to 
your customers to automate customer support. 
With all of its power, TestTrack remains the 
easiest bug tracking solution 

to use and maintain. 
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VTune’ 

by Intel 

Analyze your application's 
performance on the Intel® 
Architecture. 


The VTune Performance 
Enhancement Environment 3.0 
offers several new features: 





e New directory style navigation 
between reports 
e Non-intrusive sampling finds 
time spent in each process, module & function 


e Call graph profiling Paradise No. 
e Tuning advice for C++, FORTRAN, 123 0120-EN 


Java, and assembly language programs. $309 95 


InstallShield Pro 5.5 
by InstallShield 

Software Corp. 

InstallShield® Professional is the 
commercial developer's choice for 
creating industry-standard 
Microsoft® Windows® application 
installations.Critically acclaimed and 
used by over ninety of the top 100 
independent software vendors, 
InstallShield Professional offers both 
scripting power and timesaving visual 
tools in an integrated development 
environment. The choice for intricate 
application requirements is 
InstallShield Professional. 
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Farpoint’s Spread 
by FarPoint Technologies 


Using Spread 3 you can quickly 
create powerful database 
front-ends, manage the display 
and entry of up to two billion 
Items, print reports, perform 
calculations, read/write files, 
sort data, or simply take 
advantage of its unsurpassed 
cell-level formatting. Unmatched 
power, flexibility, and speed 
combine to make Spread the 
perfect complement to any application. 
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RoboHELP® Office 7.0 
The Industry Standard in Help Authoring 
by Blue Sky® Software 


Developers worldwide use the best-selling RoboHELP Office to create professional 
online Help, documentation, and intranet sites. RoboHELP is the industry standard in 
Help authoring, with more awards won (including PC Week Best of Comdex) than all 


other Help tools combined. 
e Produce great online documentation 
¢ Generate printed manuals, training guides, & more 
e Create the best applications 


e Auto-generate all major Help-based formats from one WinHelp file 


e Shrink support costs 

Create all standard and advanced Help features 
e Deliver projects on time 

¢ Shorten the process of creating online Help 
Y2K Compliant. 
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t Price after manufacturer's $100 


Call now to experience all the 
benefits of a RoboHELP-made 
Help system and receive a 
$100 manufacturer's rebate 
on RoboHELP Office. 


mail-in rebate while supplies last. 





WinDriver V4.0 
by KRFTech 


The device driver development toolkit. 
Write Windows 95/98/NT/LINUX 
device drivers quickly and easily in 
C/C++, using your existing 32-bit 
development tools. Supports PCI, 
Plug-and-Play, ISA, EISA, DMA, 

I/O access, Memory mapping, 
interrupts and more. Use the 
WinDriver Wizard to access your 
hardware and generate the code. 
No Kernal or OS knowledge needed. 


LEADTOOLS Imaging 
(16/32 Activex) 
by LEAD Technologies, Inc. 


LEADTOOLS is a family of 
comprehensive toolkits designed 

to help programmers integrate 

color, grayscale and document 

and medical imaging into their 
applications quickly and easily. 
Whatever your programming 

needs, LEAD has a toolkit specifi- 
cally designed to give you the best 
imaging technology available with the 
stability and dependability you would 
expect from the imaging LEADer. 
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Special support for the PLX $589 95 
9050/9054/9060/9080 chip sets. 8 





Version ‘ 
10! 





Paradise No. 
LO5 0141-EN 


449, 









Codewright Pro 
by Premia 

Codewright Pro, the programmer's 
editor for Windows, features include: 
fast code browsing with Outline 
Symbols; Difference Editing to 
selectively combine changes from 
two revisions; create complex 
function calls by just filling out a 
form; infinite extensibility with 
three macro languages; acclaimed 
sync Integration Technology and 
solid support for Web development. 
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| Quasit NT 
ServiceMaster 
by Quasit Technologies 
NT ServiceMaster is a suite of 
4 powerful controls that lets you 
build, control, and communicate 
with (using included socket 
controls) Windows NT Services, quickly and easily. Just 
think, it takes only one method call to turn your VB app 
into a robust, manageable service that can 
run unattended—even with no users logged 
in. You can even monitor and control 
services on remote machines! 
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Visual Intercept 


Enterprise 

by Elsinore Technologies 

The only suite of project-oriented 
enterprise bug-tracking tools for 

Microsoft developers. 

Complete integration with Visual 
Studio—track you bugs without 

leaving your IDE! 


VBA-enabled for complete 
customization! Status promotion model 
for controlling workflow. Integration with 
Visual SourceSafe, PVCS, ClearCase and 
other SCC systems. Web-based interfaces 
to Visual Intercept are also available! 
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Farpoint’s Button 
Objx 2.0 


by FarPoint Technologies 


Button Objx 2.0 enhances any 
Web or Microsoft® Windows® 
application. Not only can you 
replace the Windows button 
control to create visually enhanced 
buttons, you can create fully 
customized active buttons and 
toolbars as well as custom-shaped 
containers. Also included is a 
Balloon control for adding 
customized help balloons (too! tips) 
to your application. 
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DevPartner Studio Upgrade 
Paradise No. N19 0C23-EN 





Digital Visual Fortran Standard to Pro Upg. 
Paradise No. D200221-EN 285." 


InstallShield Professional Upgrade from | A 
Paradise No. 121 0333-EN *289. 


MKS Toolkit Upgrade 
Paradise No. M56 0361-EN 








Microsoft MSDN Universal Version Upgrade 
Paradise No. M47 2721-EN *1,899. 


Microsoft SOL Server Upgrade with 5 Clients 
Paradise No. M47 1123-EN $479," 


Microsoft Visual C++ Pro Ver. Upg. , 
Paradise No. M47 0D21-EN $189," 











Microsoft Visual Studio Enterprise Ver. Upg. 
Paradise No. M47 0222-EN *969.” 





Seagate Crystal Reports Pro Upgrade 














Paradise No. S08 0130-EN 169." 
True DBGrid Pro Upgrade _ 
Paradise No. A340122-EN *195.” 
Visual Test Upgrade  - 


Paradise No. R04 0B11-EN 239," 





* Price after manufacturer's $50 mail-in rebate. 





GUARANTEED BEST PRICES* 
Should you see one of these products listed at a lower 
price in another ad in this magazine, CALL US! We'll 
match the price, and still offer our same quality service 
and support! 


*Terms of the offer: 
Offer good through March 31, 1999 
Applicable to pricing on current versions of 
software listed 
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Powerful hardware and efficient 
algorithms make the difference 


Louis J. Wicker 


imulations of severe thunderstorms and tornadoes were 

closely linked to the development of supercomputers dur- 

ing the 1970s, as well as the ongoing explosion in micro- 

processor power over the last decade. What made three- 
dimensional (3D) simulations possible was the arrival of the 
Cray-1A supercomputer at the National Center for Atmospheric 
Research in 1976. This provided researchers with enough com- 
putational power to perform the first simulations of rotating 
thunderstorms, which require 3D domains. The first simula- 
tions, which used approximately 15,000 grid points evenly 
distributed within a 50x50x15-kilometer box, required near- 
ly 30 hours of CPU time and all of the Cray’s memory to sim- 
ulate two hours of a thunderstorm’s life cycle. The model out- 
put from these simulations led to our first concrete 
understanding of the flow dynamics of tornadic thunderstorms 
and began a new era in severe storm research where “cloud 
models” and supercomputers were the primary tools of dis- 
covery. (Cloud models are specialized fluid-dynamics pro- 
- grams that represent the complex airflow and thermodynam- 
ic processes that occur within a wide range of convection, 
from small fair-weather cumulus clouds to severe thunder- 
storms and tornadoes.) 

The explicit simulation of tornadoes within these thunder- 
storm simulations took almost another 10 years of research 
and technology advances. My work in this area, while a Ph.D. 
student at the National Center for Supercomputing Applica- 
tions at the University of Illinois, was greatly facilitated by the 
delivery of the first large memory (1- gigabyte) supercomputer — 
the Cray-2—in 1988. Having large in-core memory greatly 





Louis is an associate professor in the Department of Meteorolo- 
gy at Texas AGM University. He can be contacted at 
l-wicker@tamu.edu. 
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Simulating Severe 
Weather 





simplified the development of new cloud models that had mul- 
tiple grid-mesh capability. 

The simultaneous simulation of both thunderstorms and tor- 
nadoes requires a model to include motions on scales of tens 
of kilometers down to hundreds of meters or smaller. The first 
3D thunderstorm simulations in 1977 used a 2-kilometer grid 
mesh. Tornado-producing simulations require a grid mesh hav- 
ing 100-meter spacing. Increasing the mesh resolution by a fac- 
tor of 20 in each spatial direction was not feasible, because it 
would have increased CPU time by a factor of 160,000. There- 
fore, a new model had to be designed and developed; one that 
could locally enhance the grid resolution in regions of the storm 
where the tornado might form. This multiple grid technique, 
called “adaptive gridding,” still required nearly 10 million grid 
points and almost 100 hours of Cray-2 time to properly capture 
the thunderstorm and its tornado for 30 minutes of real time. 
Even with today’s powerful workstations and supercomputers, 
tornado simulations require multiple grid-mesh simulations and 
dozens of hours of computation. 


Numerical Methods of Cloud Models 

Simulation of thunderstorms and tornadoes require three 
classes of physical processes to be represented within the 
cloud model. 


e The air motion inside and outside the cloud must be rep- 
resented using traditional fluid-dynamics equations. 

e A representation of the processes that create cloud drops, rain, 
ice, snow, and hail (often referred to as “hydrometeors”) must 
be included. This representation is called the “microphysical 
parameterization.” These processes actually take place be- 
tween individual particles that are the size of a snowflake or 
raindrop. The parameterization attempts to estimate the bulk 
effects of thousands of interactions between particles that oc- 
cur in a grid volume hundreds of meters across. In addition, 
our current level of knowledge about the actual interactions 
between cloud hydrometeors within clouds is very limited. Sig- 
nificant uncertainties are associated with this parameterization. 
Therefore, it is one of the most active areas of research today 
in atmospheric science. 

e Because the numerical grid cannot represent motions on 
scales less than the grid-mesh size, some representation of 
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the subgrid effects must be included. These motions are as- 
sociated with turbulence — that is, small-scale eddies in the 
atmosphere. Turbulence acts like a blender that mixes the 
cloud and hydrometeors together. These effects are referred 
to as “turbulent mixing” and the numerical representation 
of turbulence in the cloud model is called “turbulence pa- 
rameterization.” 


All cloud models start from a form of the equations of mo- 
tion for a fluid, called the “Reynolds-averaged Navier-Stokes 
equations.” In a Cartesian rotating-coordinate system, these 
partial differential equations (PDEs) can be written as in Ex- 
ample 1, where (w,v,w) are the velocity components associ- 
ated with the (x,y,z) axes, 7 the temperature, q; the water sub- 
stances (vapor, cloud, rain, ice, and the like), p the pressure, 
p the density, R the gas constant for dry air, C, the specific 
heat of air at constant pressure, fthe coriolis parameter (which 
includes the effects of the earth’s rotation), D the turbulent 
mixing, H the heating rate of air, M the microphysical pro- 
cesses, and g the gravitational acceleration. 

Together, the equations in Example 1 describe the transport and 
mixing of heat, mass, momentum, and water substance in the at- 
mosphere, as well as the effects of microphysical processes. 











Approximating the PDEs on a grid using numerical meth- 
ods is generally a straightforward, yet detailed, process. In at- 
mospheric models, it is conventional to decompose the de- 
pendent variables of the governing equations into amplitudes 
associated with a Fourier series representation of the model 
data, or simply represent the values themselves using a set of 
grid points. In cloud models, the latter approach is used be- 
cause it is more computationally efficient when including the 
microphysics or turbulent mixing parameterizations. Approx- 
imating the equations in Example 1 on a grid mesh is done 
using the finite difference method (FDM). For example, one 
important process in the Example 1 PDEs is advection (trans- 
port) of temperature by the winds. For a 2D plane, the change 
in temperature at a given point due to advection is given in 
Example 2, where the local change of 7 at a point is minus 
each velocity component multiplied by the temperature change 
in the direction of the wind. 

Now we must discretize each term in the equation to for- 
mulate the PDE for advection on a grid mesh. For our hypo- 
thetical 2D problem, this mesh would look like Figure 1, with 
all the variables being defined at each grid point and at time 
t. Here, 7(x,y) is identical to T;;, which begins to look like a 
2D array element. Derivatives must now be represented in terms 





of the values of temperature at each grid point. You do this 
by using Taylor series expansions as in Example 3, where Ax, 
Ay, and At represent the spatial and temporal grid spacing as- 
sociated with the computational mesh (space and time). By 
rewriting these as in Example 4, a representation for PDE in 
Example 2 in terms of a temperature at each grid point and 
at time ¢t has been found. The higher-order terms (in brack- 
ets) are typically ignored. This “truncation error” in the finite 
difference approximations then appears as inaccuracies in the 
solution. For example, Figure 2 shows the advection of a 
square block of temperature in one dimension. The exact so- 
lution to this problem is the square traveling at speed wu to 
the right, and retaining its initial shape. An FDM applied to 
this problem shows errors in both shape and speed. The ini- 
tial square pulse becomes deformed and moves slower than 
the actual speed. 

This error is associated with truncating the Taylor-series 
equations. Increasing the number of grid points representing 
the temperature field will reduce the error. However, some 
truncation error will always exist. Much of the art of numeri- 
cal modeling is in trying to create more accurate versions of 
the finite difference equations (such as in Example 2) while 
not significantly increasing the computational cost. 

One important aspect of the “discretation” process is the in- 
herent numerical behavior of the FDM for a given PDE. Not all 
Taylor-series representations of the spatial and temporal deriva- 
tives can be combined together to yield an approximately cor- 
rect answer. Some combinations actually blow-up — that is, the 
value at each grid point grows exponentially with time, quick- 
ly generating an nonphysical solution. Mathematical analysis 
of the FDMs is used to determine which combination of the 
derivative approximations are stable. Often these stable 
schemes have restrictions on the size of the time step used 












Example 1: Reynolds-averaged Navier-Stokes equations. 


Example 2: Equation for the change in temperature at a 
given point in a 2D plane due to advection. 






Example fe values temperature at each point. 
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e 1: Placement of variables on a 2D mesh. 





Figure 2: One-dimensional advection using finite 
differences shown at several different times. Exact solution 
is given by a solid line, the finite difference solution is 

dashed. Flow is to the right. 


Example 4: Partial derivative equation in terms of 
temperature and time. 


Example 5: (a) Finite difference method for one- 
dimensional advection; (b) a centered-in-time and 
centered-in-space scheme. 
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(continued from page 20) 

relative to the spatial grid spacing and the flow velocity. This 
time limit is called the “Courant-Freidrichs-Levy (CFL) stability 
condition,” which can be stated for one-dimensional advection 
as in Example 5(a). This means that any feature cannot be trans- 
ported more than one grid length per time step, or else the 
scheme loses track of where things are. If this stability limit is 
violated, the finite difference scheme blows up. Another im- 
portant implication of the CFL criteria is that as the grid-mesh 
size decreases, the time step must also decrease (assuming the 
velocity is constant). Therefore, doubling the resolution of a 3D 





Figure 5: Two possible domain decompositions for parallel 
processing; (a) 2D decomposition; (b) 3D domain 
decomposition. Ps indicate that each square or cube is 
Figure 3: Cloud-model simulation-system schematic. running on a particular processor or cluster. 
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Figure 4: Plot of a simulated line of thunderstorms using an adaptive grid cloud model. The plotted domain is 400X300 
kilometers. The color image depicts the surface temperature field, where red colors mean warm air and blue cold air. The 
black contours are the individual thunderstorms within the line. Overlaid rectangles are the adaptive grid meshes 
automatically placed by the driver/management module during the integration. The outer grid has a grid spacing of 18 
kilometers, the blue-gray rectangle indicates the 6-kilometer grid mesh, and the inner white rectangles are the 2-kilometer 
meshes. (a) Simulation at 6.6 hours; (b) simulation at 10 hours. 
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(continued from page 22) 

mesh actually increases the amount of computation by a factor 
of 16, not a factor of 8, if only the number of grid points are 
considered. 

Example 5(b), an often-used stable FDM approximation, re- 
ferred to as a “centered-in-time” and “centered-in-space” 
scheme, is sometimes called the 
“Leap-Frog” scheme. The nu- 
merical solution to Example 2 is 
stepped forward in time by com- 
puting the right side of Example 
5(b). This computation is explicit; 
that is, the right side equations 
have no dependencies on vari- 
ables at time f+At. Therefore, 
these types of FDM are much 
faster to solve than implicit meth- 
ods such as those used for finite 
element simulations. This also im- 
plies that such schemes should 
be easily represented as vectors 
with parallel solutions, since 
there are no data dependencies 
associated with stepping the 
computation forward in time. 

The discretation of all partial 
derivatives in Example 1 gener- 
ates a large system of linear 
equations, which we then solve at each grid point at every 
time step. In addition to these FDM equations is the inclusion 
of the discretation of the turbulent mixing and microphysical 
processes. Turbulent mixing terms have a large set of addi- 





Simulation of thunderstorms 
requires three classes of physical 
processes represented within 
the cloud model 
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tional partial derivatives to be computed. The microphysical 
terms are also expensive to compute because they usually in- 
volve exponentiation and other complex logical and floating- 
point operations. Depending on the complexity of the turbu- 
lent mixing and the microphysical parameterizations, a 3D 
cloud model requires between 2000 and 5000 floating-point 
operations to advance the de- 
pendent variables at a single grid 
point for each time step. There- 
fore, integrating these simula- 
tions for thousands of time steps 
requires large computational re- 
sources. 


Software Design and 
Implementation 

The design and implementation 
of cloud-modeling software has 
steadily improved over the last 
25 years. Most of the original 
cloud modeling code was writ- 
ten in undocumented and often 
obtuse code, partly because the 
code needed a work-around for 
the small in-core memory ma- 
chines that were available and 
partly because many of those 
doing the programming were 
scientists who had little formal training in computer pro- 
gramming. Add to this the use of Fortran-77, a useful but un- 
structured language with no memory management capabili- 
ty, and you begin to get the picture. However, things have 


Figure 6: Three-dimensional tornadic thunderstorm. The rain within the storm is shown as the solid isosurface. The vault 
region, toward the lower left of the cloud, is where the storm’s updraft (vertical motion) is so strong that rain is being 
swept upward faster than it can fall, creating the vault. 


24 


Dr. Dobb’s Journal, March 1999 


Sesto eee tae aA PAE Pe SSE SE SENECA EEE EEE EEE EE SESH IE ETE EE TEE IEEE ITE ETE 


It’s not just your work. It’s your life. 


Keep it safe on the Jaz® 2GB drive and disks. The fastest performing 
Jaz drive with twice the capacity as the original. And it works with 
the millions of Jaz 1GB disks already out there. 2GB drives now 
priced as low as $349. Disks as low as $99. For more information 
or to find a dealer near you, visit our Web site at: www.iomega.com 


iomega 











26 








(continued from page 24) 

rapidly improved during the last 15 years. The advent of large 
core memories and supercomputing workstations has great- 
ly facilitated code development. Researchers have started to 
incorporate modern programming practices into their code. 
The lifetime of any given software has also steadily decreased 
so that new software is written more frequently. The original 
cloud-model software written for the Cray-1A remained un- 
changed for almost five years. Current software, such as my 
research program, is now improved every few months. This 
has improved the readability and organization of most codes. 
Even so, the biggest advancement has yet to be realized — 
that is, the introduction of Fortran-90— because most code 
probably should be rewritten completely to take advantage 
of Fortran-90’s structures and memory management. My own 
software will be rewritten sometime this year to take advan- 
tage of these new features. 

Figure 3 shows the design of a typical cloud-model soft- 
ware system. The function of the solver module is simply to 
take the initial conditions (the dependent variables at time 1) 
and, with the specified boundary conditions, solve the PDEs 
from Example 1 for a single time step. This would also in- 
clude the effects associated with microphysics and the sub- 
grid scale motions. The solver then returns the solution, at a 
time ¢+At, to the management module. The I/O modules are 
responsible for reading and writing the dependent variables 
at specified times and parsing the data into subsets that are 
easier to manage and store. For example, most cloud mod- 
els store the entire 3D grid data to disk every 5 to 10 min- 
utes. This produces a file or set of files that can be as large 
as 10 gigabytes. Examining all this data is difficult. Therefore, 
other I/O streams are generated, which make it easier to man- 
age the simulation. Most cloud models produce a textual out- 
put file that shows the maximum and minimum of each vari- 
able every few seconds and also outputs smaller data files 
that contain a subset of the 3D data. All of these data are 
used by researchers to track and understand what is hap- 
pening to the thunderstorm within the simulation. The tex- 
tual data is often used to monitor the simulation for solution 
stability and accuracy, while other small data files are used 
to get a quick overview of the thunderstorm’s evolution. 

Until recently, most software combined the driver and solver 
modules, since there was little to do after initialization but 
integrate the model forward in time. However, the incorpo- 
ration of adaptive gridding requires a management routine 
that not only controls the time stepping and data I/O, but 
also examines the solution to determine when and where 
new grids are needed. This driver also makes sure that nu- 
merical grids communicate their data to the other grids, which 
is necessary for accurate simulation. For example, Figure 4 
shows simulation using adaptive grids for a line of thunder- 
storms. The numerical domain is 1000x1000x20 kilometers in 
size in order to capture the entire line of thunderstorms. 
However, the individual thunderstorms need to be resolved 
using 2-kilometer grid meshes. Here the driver module, us- 
ing criteria specified by the user, places 6-kilometer and 2- 
kilometer grid meshes automatically around the line of thun- 
derstorms. The areas of active thunderstorms (the black 
contours) all are contained within 2-kilometer grids. As the 
solution evolves, the adaptive grid meshes also evolve to 
maintain solution accuracy. 


Parallel Processing 

As with many other disciplines, parallel processing has be- 
come an integral part of simulating thunderstorms and torna- 
does. Many problems require simulations that would take hun- 
dreds of hours on single- processor systems. Considerable effort 
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has been spent on porting software to various parallel sys- 
tems. Initially, versions of my cloud model were written for 
single instruction, multiple data (SIMD) systems such as Think- 
ing Machines, CM-2, or CM-5 platforms. The use of distribut- 
ed memory in these systems required a significant redesign 
and rewrite of the code. After considerable effort, the code 
was ported. However, its parallel efficiency was so low due 
to a fundamental aspect of cloud model code (and other at- 
mospheric codes as well), that the ratio between floating-point 
Operations to communication was close to unity. Therefore, a 
machine having fast processors but slow interprocessor com- 
munication would not perform well on this type of code. In- 
deed, many of the first parallel platforms had this limitation. 


Even using adaptive grids, 
simulation of the thunderstorm 
and tornado requires nearly 10 

million grid points 
and almost 100 hours 
of Cray-2 time 





In more recent architectures, such as the SGI Origin sys- 
tems or the HP Exempler systems, this problem has been some- 
what overcome. These computers have a single memory im- 
age employing a fast bus or crossbar communication system. 
Communication costs are much reduced. Parallelization of 
cloud model code is often done automatically by the compil- 
er. This proved to be a sufficient way to get 80 to 90 percent 
speedups on 10 to 30 processors, and for many simulations, 
this is certainly adequate. However, experience has shown 
that this methodology will not allow the efficient use of 
100-1000 processors. Other parallelization methods, such as 
message passing, are needed for cutting-edge simulations like 
those used to study tornadoes. 

To use clusters of SIMD systems, such as 1024 SGI Origin 
processors clustered as four 256-node machines, communi- 
cation between grid points again must be reduced. There are 
several ways to do this. Figure 5 shows commonly used meth- 
ods to reduce the communication load between processors 
or clustered systems. In two dimensions, Figure 6(a), a do- 
main decomposition is done such that a portion of the com- 
putational grid is running on each processor (or cluster). 
Communication is reduced, because only values along the 
edges of each subgrid need to be communicated to neigh- 
boring subegrids running on other processors (clusters). Fig- 
ure 6(b) shows the extension of domain decomposition to 
three dimensions, by dividing the domains vertically as well 
as horizontally. It can be shown that for 3D domains, the 3D 
domain decomposition is the most efficient method of re- 
ducing the amount of communication per floating-point op- 
eration. Using these methods, speedups of 70 to 80 percent 
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Figure 7: Control panel and visualization image using Vis5D to analyze a simulation of a tornadic thunderstorm. The 
image on the right shows several different variables. The gray isosurface is the cloud rainwater, the vertical contour slice 
shows the updraft, the bottom blue image is the surface temperature, and the tubular yellow isosurface represents the 


tornado that extends from the surface upward into the cloud. 


can be obtained. This methodology, which is widely used in 
fluid- dynamic software, has allowed simulation speeds to ap- 
proach 100 gigaflops. 

Again, large parallel simulations of thunderstorms and tor- 
nadoes produce tens of gigabytes of data. Thunderstorm flows 
are complex and continually evolve over the entire simula- 
tion, which can be up to five hours long. Therefore, sophis- 
ticated analysis and visualization tools are needed to explore 
and understand the dynamics of the storm. 


Visualization 

Perhaps the greatest challenge facing atmospheric scientists 
today— both in thunderstorm modeling and elsewhere — is 
to be able to access, analyze, and understand the billions of 
numbers that can now be routinely generated by current su- 
percomputers or even workstations. 

Scientific visualization is therefore a crucial tool for a re- 
searcher. However, while cloud models are a fairly mature 
technology, it seems clear that the tools needed to examine 
such data are only just beginning to mature. Early scientific 
visualization of clouds (see Figure 6) used visual artists and 
animators to generate the images using sophisticated model- 
ing software such as Wavefront (http://www.wavefrontsciences 
.com/). These images were relatively expensive to create in 
terms of time and effort, and clearly were not practical for 
day-to-day access and analysis. As workstation power has in- 
creased, more interactive tools have become available. One 
of the most popular and useful tools used today to visualize 
cloud model and other atmospheric model data is a package 
called Vis5D, developed by Bill Hibbard at the University of 
Wisconsin-Madison (http://www.ssec.wisc.edu/software/ 
software.html). By compressing the data, this software takes 
a series of 3D data files generated from the model and com- 
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bines them to produce a 4D data set (space and time) that 
can be quickly examined in a variety of ways. The visual- 
ization methods include isosurfaces, vector planes, slice im- 
ages, and trajectories (weightless particles following the flow), 
all of which can be manipulated interactively. Researchers can 
quickly modify the parameters associated with each tool to 
bring out certain features within the date. This type of capa- 
bility— especially that of time animation— enables researchers 
to grasp the development evolution of the thunderstorm and/or 
tornado. The interactivity is crucial for rapid and compre- 
hensive analysis of the storm simulation. For example, the 
complex image in Figure 7 was generated in only a few min- 
utes, yet the information communicated to a researcher can 
be very significant. 


The Future 

Beginning in the mid 1970s, the first simulations of thunder- 
storms by researchers significantly increased our understand- 
ing of thunderstorm behavior. During the last 20 years, our 
new understanding of these phenomena has improved fore- 
casts of thunderstorms and tornadoes to the public. Without 
the development of supercomputers and workstations during 
this period, much of this new knowledge would not have been 
discovered. Therefore, the continued development of com- 
putational tools, both hardware and software, is vital to in- 
creasing our understanding and improving forecasts of these 
phenomena. 
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The Unified Modeling Language 

(UML) is rapidly becoming the stan- 
dard language that all developers 

and managers need to know to 

_ define, visualize, build and docu- 

- ment the various components of _ 

complex software systems. UML 

_ World will show you how to simpli- 

_ fyyour development process and 
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leverage its efficiencies in all of your 








projects. Spending a few short days 
at UML World can save you many 
___ days of work in the future! 


At UML World you will: 
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™@ LEARN a standard set of diagrams and 
notations for modeling object-oriented 
systems. 






BE DISCOVER project development process- 
es and the use of patterns as solutions 
to recurring problems in design. 












@ EXPLORE modeling tools to make 
informed decisions on what is appropri- 
ate for your organization. i 
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A simulator engine 
in C++ 





Donald C. Craig 


imulators provide an economical 
means of understanding and evaluat- 
ing the performance of both abstract 
and real-world systems. Unfortunate- 
ly, the design and implementation of sim- 
ulators is almost as complex as the systems 
being simulated. To be efficient, therefore, 
simulators must be able to adapt to ever- 
increasing system complexity. Luckily, the 
object-oriented paradigm lends itself to im- 
plementing simulators that are extensible, 
while preserving their relative efficiency. 
In this article, I'll present an approach 
by which hardware components can be 
represented and simulated hierarchically 
using C++. Unlike traditional event simu- 
lators, the simulation strategy I describe 
here does not use the concept of a glob- 
al event queue or global clock to syn- 
chronize the events that are propagated 
through components within the simula- 
tion. Instead, this simulation strategy is 
completely asynchronous, meaning that 
the concept of global time has been aban- 
doned in favor of each component main- 
taining its own concept of local time (see 
“Asynchronous Distributed Simulation via 
a Sequence of Parallel Computations,” by 
K.M Chandy and J. Misra, Communica- 
tions of the ACM, April 1981). By elimi- 
nating the reliance of components upon 
a global event queue for synchronization, 
the autonomy of each component is in- 
creased, making it easier to distribute the 
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- simulation over several hierarchical com- 


ponents. 

This approach is central to a simulation 
tool I’ve built called “DigiTcl.” This tool con- 
sists of a GUI that lets users construct and 
simulate digital circuits. The GUI was im- 
plemented using Tcl/Tk8.0 and serves as the 
front end for the simulator engine, which 
was written in C++. Here, I focus on the 
simulator engine, specifically how C++ com- 
ponents interact with one another. DigiTcl 
(available electronically from DDJ, see “Re- 
source Center,” page 5, and at http:// 
www.cs.mun.ca/~donald/digitcl/) is avail- 
able as a gzipped tar file and as a zip archive. 





The release content in both archives is the 
same. The simulator engine will have to be 
compiled for your platform; refer to the 
README file for more details. 

C++ supports features that make it fa- 
vorable for the description of hardware at 
the logic level (see “Object-Oriented Pro- 
gramming for CAD,” by Wayne H. Wolf, 
IEEE Design & Test, March 1991). It has, 
for instance, comprehensive support for 
encapsulation and inheritance, both of 
which I use extensively when describing 
hardware. I also use the language’s sup- 
port for polymorphism when implement- 


Simulation 


ing the simulation algorithm. In addition, 
the code employs a modest use of Stan- 
dard Template Library (STL), but does not 
use exception handling (to ensure porta- 
bility with existing C++ compilers). 

One of the goals of object-oriented de- 
sign is to create classes that correspond 
either to entities in the real world or to 
abstractions that have a well-defined state 
and behavior (see Object-Oriented Anal- 
ysis and Design with Applications, Second 
Edition, by Grady Booch (Benjamin/Cum- 
mings Publishing, 1994): This is the ap- 
proach I adopted when developing the 
class library used to describe and simu- 
late logic hardware. 


The Component Class 

The primary functional entity in most cir- 
cuits is the component. At the lowest lev- 
el of abstraction, a component is the en- 
tity that performs the logic transformations 
that, in turn, give the circuit its behavior. 
At higher levels of abstraction, a compo- 
nent can be composed of other subcom- 
ponents in a hierarchical manner, during 
simulation, higher level components sim- 
ply delegate simulation responsibility to 
subcomponents. Listing One presents the 
Component class. 

The Component class defines a public 
input port list W_List) and public output 
port list (O_List). These data members are 
made public because they represent the 
interface through which the component 
communicates with the external world. 
The class contains data members for the 
transport delay, the name of the compo- 
nent (which can be used for debugging 
purposes), and the component's local time 
(used during the simulation). The ckt_time 
type is simply typedefed to be of type Jong. 

The constructor takes a ckt_time value 
representing the delay of the element and 
a string representing the component’s 
name. Both values are stored in the cor- 
responding data members by the con- 
structor. For components composed of 
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(continued from page 32) 
subcomponents, the delay of the encom- 
passing component is determined by the 
cumulative delays of its subcomponents. 
In this case, the delay parameter is irrel- 
evant. The constructor for the Component 
class is made protected so as to enforce 
the abstract nature of the class. To actu- 
ally create a component, you must derive 
a component from the Component class. 

Components need a means by which 
they can communicate with other com- 
ponents in the circuit. This leads to the 
creation of another high-level class— the 
Connector. 


The Connector Class 

The basic function of the Connector class 
is to act as the conduit through which sig- 
nals are retrieved and propagated from 
one component to another. As such, the 
Connector class has methods that can re- 
ceive and transmit signals, see Listing Two. 
Because the Connector class is abstract, 
both the get_signal() and send_signal() 
methods are defined as pure virtual meth- 
ods, thereby preventing the instantiation 
of a Connector class. The Signal class it- 
self is simply an aggregate consisting of a 
signal value and the time that the signal 
value occurred. 

As with the Component class, the Con- 
nector class declares a protected construc- 
tor, which simply takes the name of the 
connector and stores it in the name data 
member. The Connector class also contains 
a list of components to which it is con- 
nected. This represents the fan-out of the 
connector. Components are added to this 
data member via the connect() method. 

During hierarchical simulation, a com- 
ponent must have a mechanism through 
which it can communicate with compo- 





nents in the same level of the hierarchy 
and with components in lower levels (that 
is, its subcomponents). These two goals 
are accomplished by the Wire and Port 
classes, respectively, both of which are 
derived from the Connector class. 


The Wire Class 

The Wire class (Listing Three) provides 
two constructors. The first (default) con- 
structor is used to create a wire with an 
initial undefined input, while the second 
initializes a wire with the supplied array 
of signal values and times. This construc- 
tor initializes the primary inputs for the 
circuit being simulated. 

In addition to connecting components 
at the same hierarchical level, wires also 
act as signal archivers. During simulation, 
all signals that are sent through a wire are 
archived so that all components that re- 
quire input from the wire can retrieve sig- 
nals from it at any time. 

The Wire class provides the add_sig- 
nal() method to add a signal to a wire. 
This method simply appends the supplied 
signal to the wire after ensuring that the 
signal is not out of time order with the 
last signal already on the list. 

The Wire class overrides both the 
get_signal() and send_signal() methods 
defined as pure virtual functions in the 
base Connector class. 


The Port Class 

The Port class (Listing Four) lets compo- 
nents communicate with their nested sub- 
components. The Port class was first used 
in the declaration of the Component class. 
As with the Wire class, the Port class also 
overrides both the get_signal() and 
send_signal() methods of its base Con- 
nector class. 


Figure 1: Three-dimensional representation of the 3-input AND gate. 
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Like its base class, Connector, the con- 
structor for Port is protected, thereby al- 
lowing only classes derived from it to be 
instantiated. Port maintains a pointer to 
the external connector to which it is con- 
nected. This data member is assigned the 
Connector reference parameter passed to 
the Port constructor. Because the exter- 
nal data member is a pointer to a Con- 
nector, it can legitimately point to either 
a Wire object or another Port object. 

Finally, two classes are derived from 
the Port class— an Input and Output class; 
see Listing Five. Both classes define pub- 
lic constructors, therefore allowing objects 
of type Input and Output to be instanti- 
ated. Both Input and Output constructors 
take, as parameters, a reference to the 
Component in which the port is contained, 
the external connector for the port, and 
an optional string representing the port 
name. The constructors for both the Jn- 
put and Output port simply pass the Con- 
nector reference and the name string to 
their base Port class constructors for stor- 
age. Also, as part of their construction, 
both Input and Output classes add point- 
ers to themselves to the input/output port 
lists of the Component that is supplied to 
the constructor. The Input port construc- 
tor also adds the supplied component to 
the fan-out list of the external connector. 
This is done so that the external connec- 
tor can find the component to which it is 
connected during the simulation. 

Because input ports can only request 
signals (not send them), /nput overrides 
the send_signal() method to generate a 
diagnostic error should this method be in- 
advertently called for an input port. 


A 3-Input AND Gate Example 
To demonstrate how these classes can be 
used to hierarchically describe hardware, 
I'll build a 3-input AND gate by using two 
2-input AND gates and an internal wire. 

First, you define a 2-input AND gate; 
see Listing Six. The And2 class is derived 
from the Component class. The construc- 
tor takes three Connector references — 
two inputs and one output. These con- 
nectors represent the external linkages of 
the component to the outside world. The 
constructor also optionally permits the 
specification of a transport delay and a 
name for the component. The And2 class 
also overrides the process() method so as 
to implement the gate’s logic. 

Listing Seven is the actual constructor. The 
delay and the component name are passed 





Figure 2: Typical simulator engine 
output. 
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(continued from page 34) 

to the base Component class for initializa- 
tion and the Port constructors are called to 
build up the component's input and output 
port list and link up the component's ports 
with the supplied connectors. 

Finally, you construct the 3-input AND 
gate using two 2-input AND gates and a 
wire. Listing Eight is the class for the 3- 
input AND gate. The constructor takes 
four connector references— three inputs, 
one output, and an optional name. Pri- 
vately, the class encapsulates the three in- 
put ports— one output port, the wire, and 
the two 2-input AND gates. 

Listing Nine shows the constructor for 
the 3-input AND gate. As with the 2-input 
AND gate, the constructor does all of its 
initialization in the member initialization 
list. The three input ports and the output 
port are connected to the external con- 
nectors, the wire is constructed, and the 
two 2-input AND gates are built and con- 
nected to the ports and wire of the 3-input 
AND gate. Because the transport delay of 
the 3-input AND component is deter- 
mined by the transport delay of its two 2- 
input AND subcomponents, an unused 
transport delay value is passed to the base 
Component constructor. 

Once all the connections have been 
made, the hierarchical component in Fig- 
ure 1 is constructed. 


Hardware Simulation 

The simulation of a circuit, represented 
using the strategy just described, is simi- 
lar to a depth-first traversal of the 3D hi- 
erarchy of components along the wires 
and ports. Components may be visited 
multiple times during the traversal over 
the course of the simulation. The basic 
strategy behind the simulation is for a com- 
ponent to propagate any output it pro- 
duces immediately to all the components 
to which it is connected. Signals are prop- 
agated horizontally and vertically through 
the hierarchy. 

The primary method responsible for 
simulating a component is the simulate() 
method (Listing Ten), which is inherited 
by all components and should not be 
overridden. This method processes the 
component’s inputs and updates its local 
time as long as its inputs are available. 
When all the inputs have been processed, 
the simulate() method terminates. 

The inputs_are_ready() method scans 
the component’s list of input ports and 
calls the get_signal() method to determine 
if all the input signals are available at the 
local time of the component. If so, it will 
return True; otherwise, False is returned. 

Components composed of subcompo- 
nents process their inputs differently than 
components that are leaf nodes in the hi- 
erarchy. The former components essen- 
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tially delegate simulation responsibilities 
to its subcomponents, while the latter ones 
actually perform the low-level functional 
logic of the circuit. Listing Eleven is the 
process() method for high-level compo- 
nents. All nonleaf components should in- 
herit this method, which propagates input 
signals to the nested subcomponents. 

Because And2 is a low-level leaf com- 
ponent, it overrides the process() method; 
see Listing Twelve. The method uses the 
get_signal() method of the Port class to 
obtain the inputs which occurred on the 
two input wires at the specified time and 
performs the AND option on them. A re- 
sultant output signal is created and the 
send_signal() method of the output port 
is used to send it to the appropriate wire 
and propagate it to the components in the 
output’s fan-out. 

Listing Thirteen presents the Connec- 
tors propagate() method, used by the 
simulate() method of the Component base 
class. This method simply iterates over all 
the components in the Connector’s fan- 
out and tells them to simulate. This is the 
mechanism by which signal propagation 
occurs during the simulation. 

Next, the get_signal() and send_sig- 
nal() methods of the Wire class are de- 
fined. The get_signal() method (Listing 
Fourteen) scans the linked list of signals 
searching for the signal that occurred at 
the time passed to this method. This 
method assumes that if signal value X oc- 
curred at time ¢1 and signal value Y oc- 
curred at time #2 (where /2>11), then the 
value of the signal at time ¢ (where 
t1<=/<i2) is X. If the signal is not found, 
an undefined signal—with an undefined 
value and undefined time— is returned. 

The send_signal() method (Listing Fif- 
teen) adds the supplied signal to the wire’s 
archive of signals and attempts to propa- 
gate the signal to the wire’s fan-out list of 
components (which the Wire class inher- 
ited from the Connector class). The 
add_signal() method itself does some san- 
ity checking of the current state of the sig- 
nal list before actually pushing the signal 
value onto the back of the list. 

The Port’s get_signal() and send_signal 
methods are relatively simple; see Listing 
Sixteen. The get_signal) method obtains 
the signal that occurred at the specified time 
by querying the external connector. This 
method recurses from port to port up the 
hierarchy until the get_signal() message is 
eventually sent to a wire external connec- 
tor, after which the recursion unfolds. 

The Port’s send_signal() method sends 
the supplied signal to the outside world 
using the external connector. This method 
recurses until a send_signal() message is 
sent to a Wire object. Since every port 
eventually connects to a wire, this recur- 
sion eventually terminates and unfolds. 


After sending the signal to the outside 
world, an attempt is made to propagate | 
the signal to components which are at the 
same level of the hierarchy and are in the 
fan-out list of the port. 

Finally, the main driver function (List- 
ing Seventeen) creates three signal arrays 
and populates them with the primary in- 
puts for the 3-input AND gate. Four wires 
are then created (three to hold the input 
values and one to hold the outputs). The 
3-input AND gate is then constructed with 
the appropriate parameters. The simu- . 
late() method is then sent to the compo- 
nent and the output values of the 3-input 
AND gate’s output wire are displayed. 

Upon running the program, the output 
in Figure 2 is produced. The format of the 
output is a list of pairs. The first element of 
the pair is the time that the signal occurred 
(where underscore represents the initial 
time) and the second value represents the 
actual value of the signal (either 0, 1 or X). 


Conclusion | 

As you can see, simple logic components 
can be represented and simulated hierar- 
chically using C++, and the code required 
is relatively compact and straightforward. 
However, the simulator engine is some- 
what clumsy to use, since it actually re- 
quires recompilation whenever a new 
composite component is created. 

The DigiTcl GUI does make the simu- 
lator easier to use, at least when laying 
out circuit components and wiring them 
together. Communication to and from the 
simulator engine was implemented by a 
bidirectional pipe. The GUI feeds the sim- 
ulator both the circuit description and the 
input signals to the simulator engine via 
the pipe. The simulator constructs the cir- 
cuit, simulates it, and passes the corre- 
sponding output signals through the pipe 
back to the GUI for display. Unfortunate- 
ly, the GUI does not support the hierar- 
chical composition of components. This 
is something you might want to add. 

Another enhancement would be to use | 
CORBA as a means to distribute the sim- 
ulation. Because there is no need for a 
central point of control (such as a global 
event queue or a global clock), the wires 
and components that comprise the circuit 
can be distributed over several different 
processes or even over several different 
processors. The relatively simple interfaces 
that make up the Component, Wire, and 
Port classes make this idea tempting. 
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e e 
Listing One 
class Component 
public: 
virtual ~Component () ; 
list<Port *> I_List; 
list<Port *> O_List; 
virtual void process(ckt_time) ; 
void simulate(); 
protected: 
Component (ckt_time delay = 1L, const char *name = "Component") ; 
ckt_time delay; 
private: 
boolean inputs_are_ready() const; 
char *name ; 
ckt_time local_time; 
3 
e e 
Listing Two 
class Connector 
{ 
public: 
virtual ~Connector(); 
virtual Signal get_signal(ckt_time) const = @; 
virtual void send_signal(Signal) = @; 
void connect(Component &) ; 
void propagate() const; 
protected: 
Connector(const char* = "Connector") ; 
private: 
list<Component *> fan_out; 
char *name; 
he 
e e 
Listing Three 
class Wire : public Connector 
{ 
public: 
Wire(const char *name = "Wire"); 


Wire(Signal s[], int num, char *name); 


Signal get_signal(ckt_time) const; 
void add_signal (Signal) ; 


private: 


list<Signal> signals; 
33 


Listing Four 


class Port : public Connector 


{ 
public: 
Signal get_signal(ckt_time) const; 
void send_signal (Signal) ; 
protected: 
Port(Connector & const char* = "Port"); 
Connector *external; 
33 


Listing Five 


class Input : public Port 


{ 

public: 
Input (Component &, Connector &, const char *name = "Input"); 
void send_signal (Signal) ; 

}; 

class Output : public Port 

public: 
Output (Component &, Connector &, const char *name = "Output") ; 

ban 

® e e 

Listing Six 

class And2 : public Component 

{ 

public: 


And2(Connector &, Connector &, Connector &, 
ckt_time = 1L, char* = "And2"); 
void process(ckt_time) ; 


private: 
Input 11, 223 
Output 01; 

}3 


Listing Seven 


And2::And2(Connector &cil, Connector &ci2, Connector &col, 
ckt_time dly, char *n) : 
Component (dly, n), 
Ii (*this, cil, "And2 I1"), 
I2 (*this, ci2, "And2 12"), 
O1 (*this, col, "And2 01") 
{ } 


(continued on page 38) 
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(continued from page 37) 
Listing Eight 

class And3 : public Component 

( 


public: 
And3(Connector &, Connector &, 
Connector &, Connector 4, 
char* = "And3"); 


private: 
Input. 11, 12,. 23; 
Output 01; 
Wire W; 
And2 and2a, and2b; 
}; 
e ® e 
Listing Nine 


And3::And3(Connector &cil, Connector &ci2, 
Connector &ci3, Connector &col, 
ckt_time dly, char *n) : 

Component (CKT_TIME_NULL, n), 
Ii (*this, cil, "And3 I1"), 

I2 (#this, ci2, "And3 12"), 

I3 (*this, ci3, "And3 I3"), 

01 (#this, col, "And3 01"), 
w("And3 wire"), 

and2a(I1, 12, w, 1L, "And2a"), 
and2b(w, 13, 01, 1L, "And2b") 


{ } 
The 3-input AND gate constructor. 
e e 
Listing Ten 
void Component: : simulate () 
{ 


// Continue to simulate the component as long as inputs signals 
// exist at the current local time of the component. 
while (inputs_are_ready () ) 


{ 
// If so, then increment local time here. 
// Otherwise, circuits with feedback go on forever. 
local_timet+; 
// Send the process message to component. This may trigger further 
// simulate() messages depending upon connectivity of component. 
process(local_time - 1); 
} 
} 
e e 
Listing Eleven 
void Component: : process (ckt_time) 
4 
list<Port *>::const_iterator pi 
// Scan all the input port pointers in the input port list 
// and activate any subcomponent immediately connected to an input port. 
for (p = I_List.begin(); p != I_List.end(); p++) 
(*p)->propagate() ; 
} 


Listing Twelve 


void And2::process(ckt_time t) 


{ 
Sig_Val sigval1 = I1.get_signal(t).get_value() ; 
Sig_Val sigval2 = I2.get_signal(t).get_value() ; 
if (sigval1 == SIG_HIGH && sigval2 == SIG_HIGH) 
01.send_signal(Signal(t + delay, SIG_HIGH)); 
else if (sigval1 == SIG_LOW || sigval2 == SIG_LOW) 
O1.send_signal(Signal(t + delay, SIG_LOW)); 
else 
01.send_signal(Signal(t + delay, SIG_X)); 
} 
e @ e 
Listing Thirteen 
void Connector: :propagate() const 
{ 
list<Component *>::const_iterator c; 
// Scan all the elements in the component pointer list and 
// send simulate() messages to each of them. 
for (c = fan_out.begin(); c != fan_out.end(); ct+) 
(*c)->simulate(); 
} 
L) e 
Listing Fourteen 


Signal Wire::get_signal(ckt_time t) const 


// If signal list is empty or if time we are looking for is greater than 
// the time last signal came into wire, then return an undefined signal. 
if (signals.empty() || signals.back().get_time() < t) 

return Signal(CKT_TIME_NULL, SIG_NULL) ; 


list<Signal>: :const_iterator 
Signal found; 


s = signals.begin(); 


// Do a linear scan over the list and return the signal that occurred 
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// at the specified time (if it exists). 

while (s != signals.end() && (*s).get_time() <= t) 
found = *st+; 

return found; 


Listing Fifteen 


void Wire::send_signal(Signal sig) 


{ 
add_signal (sig) ; 
propagate () ; 
Listing Sixteen 


Signal Port::get_signal(ckt_time t) const 


// Send message to the external feeder to get its signal. 
return external->get_signal (t) ; 

} 

void Port::send_signal (Signal s) 

{ 
// Send the signal to the external Connector. 
external->send_signal(s) ; 
// Propagate the signal at the current level of the hierarchy. 
propagate(); 


} 
e ® 

Listing Seventeen 

int main() 

{ 
// Create signal arrays for the inputs. 
Signal Signali[] = 
{ 


// (®@ 1} (2 0} (3 1} {4 0} (31 0} 
Signal(@, SIG_HIGH), 
Signal(2, SIG_LOW), 
Signal(3, SIG_HIGH), 
Signal(4, SIG_LOW), 
}; 
Signal Signal2[] = 
{ 


// (@ 1} {1 OF {2 1} {4 0} (31 0} 
Signal(@, SIG_HIGH) , 
Signal(1, SIG_LOW), 
Signal(2, SIG_HIGH), 
Signal(4, SIG_LOW) 
I; 
Signal Signal3[] = 
t 


// (@ 1} {2 0} {4 1} {5 0} (31 0} 

Signal(@, SIG_HIGH), 

Signal(2, SIG_LOW), 

Signal(4, SIG_HIGH), 

Signal(5, SIG_LOW) 
x 
// Build input & output wires and populate input wires with input signals. 
Wire wi(Signali, sizeof(Signal1) / sizeof(Signal), "Main in_wi"); 
Wire w2(Signal2, sizeof(Signal2) / sizeof(Signal), "Main in_w2"); 
Wire w3(Signal3, sizeof(Signal3) / sizeof(Signal), "Main in_w3"); 
Wire w4("Main out_w4") ; 


// Build the 3-input AND gate, simulate it and show its output. 
And3 and3(wi, w2, w3, w4, CKT_TIME_NULL, "and3"); 
and3.simulate(); 

and3.show_outputs() ; 


return @; 


DDJ 
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Simulating the Enigma 
cryptographic machine 





Paul Tremblett 


he Java Cryptography Extension, an 

extension of the Java Development 

Kit, promises plug-in cryptographic 

libraries and seamless addition of new 
algorithms. It accomplishes this by using 
Java’s “provider” architecture. 

Providers are Java packages (or sets of 
packages) that deliver concrete imple- 
mentations of facilities such as message 
digests, digital signatures, keys, certificates, 
algorithms, and random-number genera- 
tors— all important components of cryp- 
tography. In this article, I'll implement a 
cipher algorithm, which simulates the Enig- 
ma machine made famous by Germany 
in World War II. The encryption technique 
used by Enigma is sufficiently strong so 
as not to be as boring as a Caesar cipher 
or a Vigenere cipher; on the other hand, 
since the technique has been so well de- 
scribed and since so much as been writ- 
ten about how to crack Enigma, it is weak 
enough to pose no great threat. The ci- 
pher is symmetric and the key I use is de- 
rived from a simple pass phrase. It’s worth 
mentioning that, as a citizen of the Unit- 
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Beechwood. He can be reached at 
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ed States, I have access to the Java Cryp- 
tography Extension that is not available to 
readers outside the U.S. and Canada. 
These readers can obtain one of the func- 
tional equivalents of JCE that are not sub- 
ject to U.S. export laws. 


Constructing the Machine 
The object paradigm lends itself to con- 
structing the software Enigma. You sim- 
ply create classes corresponding to the 
components of the machine and write 
methods that simulate the behavior of data 
passing through these components. 


4 tee 








ao eae arene 


The main component of the original 
Enigma machine was the rotor, a disk 
with 26 contacts on each side and a set 
of wires that randomly connected the 
contacts on one side to the contacts on 
the other. Current flowing in through the 
contact located in the first position on 








one side might emerge on the other side 
at the contact located in the eighteenth 
position. A movable outer rim on the disc 
permitted the full alphabet to be shifted 
relative to the contacts. Before inserting 
a disc into the machine, a “starting let- 
ter” was chosen and the rim was rotated 
so that this letter was visible when the 
disc was inserted. The Enigma machine 
was equipped with five such rotors, three 
of which were chosen for any given us- 
age of the machine. A message encrypt- 
ed with a given set of three rotors set to 
selected start positions could only be de- 
crypted using the same three rotors in- 
serted into the machine in the same or- 
der using the same start positions. 

Each time a letter was typed on the key- 
board, the first disc was rotated one posi- 
tion. When the rotation caused a notch on 
the disk to pass a certain position, the sec- 
ond disc was rotated one position in the 
same manner as the tenth’s digit on your 
car’s odometer is advanced one digit each 
time the units digit hits zero. The tripping 
of a notch on the second rotor likewise 
caused rotation of the third rotor. 

EnigmaRotor.java is the code for the 
software version of a rotor; see Listing 
One. It contains 256 contacts because it 
must accommodate all possible values of 
a byte. The internal cross wiring, instead 
of being done at the factory where the ro- 
tor was manufactured, is performed by 
the constructor when an instance of Enig- 
makRotor is created. The pairs of contacts 
are implemented using two arrays— one 
for each direction. Using this approach, 
you can avoid lookups and use direct 
indexing to obtain the mapping of any 


Dr. Dobb’s Journal, March 1999 





Time to market. 

It's the biggest challenge every 
developer faces. But now there’s something 
that can help you conquer it. An amazing 
new framework that will enable you to 
develop your applications much, much 
faster than before. | 


The Unicenter TNG 
Framework Can 
Save You Years Of 
Development Time. 
The Unicenter® TNG™ Framework™ provides 
an instant foundation for virtually any kind 
of application you need to develop. 
It provides all of the common services 
your applications will ever need. Basics like 


Unicenter® TNG™ uses virtual reality to create a 3-D environment 
representing objects in the real world. 

calendar management, object repository, and 
virus detection are just a few of the dozens of 
services that are included for free. 

sure, you could write your own, but do 
you have countless months to do it? And would 
it be as robust as everything Unicenter TNG 
can give you today? Not to mention, it would 
take even the most gifted developer a very 
long time to develop some of the very uncom- 











mon services the TNG Framework offers. Like 
a revolutionary 3-D Real World Interface™ that 
incorporates virtual reality. And innovative 

Business Process Views™ that let users look at 


their systems and processes any way they like. 


Why spend the next five years building 
your applications from scratch, when you can 
use the Framework to get an edge on your 
competition today? 


Unicenter TNG Framework 

Provides All Your Applications 

With Cross-Platform Support. 
With the Unicenter TNG Software 
Development Kit and FREE Unicenter TNG 
training programs, you'll be able to develop 
for the broadest variety of UNIX and NT plat- 
forms. In fact, Unicenter TNG is the most 
open, interoperable, and scalable manage- 
ment solution available. Today, over a dozen 
companies are shipping the Unicenter TNG 
Framework with their systems. Companies 
like HP, DIGITAL, NCR, Tandem, SGI, Data 





The Framework Is FREE. 
The Benefits Are invaluable. 





General, SCO, and Fujitsu, to name 
a few. They ship it, so you don’t 
have to. 


Unicenter TNG Is Widely 
Recognized As The industry 
Standard For Network And 
Systems Management. 
Unicenter TNG is the only man- 
agement solution that has been 
supported by virtually every major 
hardware and software company, 
including Microsoft, Sun, SAP, Intel, 
HP, DIGITAL, Tandem, NCR, SGI, and 
Data General. /nformation Week 
summed it up best when it recently 
said “Unicenter TNG is a generation ahead of 
the competition.” 








# Of Develop _‘ Person 
Developers Time (mos.) Mos. With TNG Framework 


2-D and 3-D 
User Interface 5 8 40 





Available Now 
Object : 
Repository 8 12 96 Available Now 
Auto Discovery 6 9 54 Available Now 
Calendar : 
Management 5 8 40 Available Now 


Available Now 
Available Now 


Virus Detection 3 7 21 
Reporting 


Business 
Process Views™ 


Event 
Management 


Delivery — 
Timeframe 





Available Now 


Available Now 


- SHIP Today 


Why waste time? Unicenter TNG Framework can 
save you countless months. 


Call 1-888-UNICENTER Today For Your 
FREE Unicenter ING Framework, 
Or Visit www.theframework.com. 
Call today and give yourself a FREE head start 
on every single application you develop. 
It just might be the competitive edge you 
need. To finish first, every time. 









A OMPUTER® 
iSSOCIATES 





Software superior by design. 


Unicenter ING Framework 


©1998 Computer Associates International, Inc., Islandia, NY 11788-7000. All product names referenced herein are trademarks of their respective companies. 













Tools 





Visual Parse++ is the only tool that brings 
cutting edge ae technology to all 


developer's. You can design any parser 
Without ever leaving our sophisticated 
visual development environment. 
Whether youre new to parsing 
technology, or an experienced veteran, 
Visual Parse++ is the right tool for you. 


Visual Parset+ provides native pro- 
Cie support for C, C++, Java, 
Visual Basic, and Delphi. Our C++ and 
_ Java classes are fully supported on all 
_ platforms. Visual Parset+ also comes 
_ with drop-in parsers for HTML, SQL, 
RTE, Java, C, C++, and more. 


New to version 3.0 is natural lan peze 
_ parsing. Visual Parse++ is easily the 
_ most pace parsing engine in the 
world with generalized parsing 
Capability. Visual Parse++ now can 
handle any grammar, including 
_ ambiguous grammars. This opens up the 
area of natural language parsing, 
among other applications. Also included 
is a brand new user interface, with many 
new features and improvements, along 
_with 3D parse tree and machine views. 






C++|Delphi| Active 





Order a copy today! 


Gall 800-988-9023 
~ WWW.Sand-stone.com 


SandStone Technology 


939 Coast Blvd 

* Suite 4 

- La Jolla, CA 92037 
Phone: OS 454-9404 

| Fax: (619) 454-9467 

willd @ sand-stone.com 

Wwww.sand-stone.com 











(continued from page 40) 

contact in either the forward or backward 
direction. The instance variable current- 
Position is incremented each time the ro- 
tor is advanced one position (that is, each 
time the advance() method is invoked). 
When it attains a value of 256, it is reset 
to zero; this simulates rotation. Each time 
currentPosition reaches notchPosition, 
an exception is thrown. (Listing Two is 


PROVIDER # 1 
SUN version 1.2 


EnigmaRotorTrippedExcepion.java — 
code that catches this exception advances 
the next rotor.) 

EnigmaRotor contains three methods: 


e setStartPosition() achieves the same re- 
sult as rotating the outer ring on the 
hardware version. 

e advance() does exactly what its name 
implies. 


info: SUN (DSA key/parameter generation; DSS signing; SHA-1, MD5 digests, 


SecureRandom) 
name: SUN 
version: 1.2 
string: SUN version 1.2 


PROVIDER # 2 
SunJCE version 1.2 


info: SUN JCE Provider (implements DES, Triple DES, PBE, Diffie-Hellman) 


name: SunJCE 
version: 1.2 | 
string: SunJCE version 1.2 





Example 1: Result of running the ListProviders program. 


com/ 
com/beechwood/ 
com/beechwood/crypto/ 


com/beechwood/crypto/provider/ 


com/beechwood/crypto/provider/Corbett.class 


com/beechwood/crypto/cipher/ 


com/beechwood/crypto/cipher/Enigma.class 
com/beechwood/crypto/cipher/EnigmaMachine.class 
com/beechwood/crypto/cipher/EnigmaRotor.class 
com/beechwood/crypto/cipher/EnigmaRotorTrippedException.class 
com/beechwood/crypto/cipher/EnigmaReflector.class 


com/beechwood/crypto/spec/ 


com/beechwood/crypto/spec/EnigmaParameterSpec.class 


com/beechwood/crypto/interfaces/ 


com/beechwood/crypto/interfaces/EnigmaParams.class 


Example 2: Contents of enigma jar. 


PROVIDER # 1 
SUN version 1.2 





info: SUN (DSA key/parameter generation; DSS signing; SHA-1, MD5 digests, 


SecureRandom) 
name: SUN 
version: 1.2 
string: SUN version 1.2 


PROVIDER # 2 
SunJGHR version 1.2 


info: SUN JCE Provider (implements DES, Triple DES, PBE, Diffie-Hellman) 
name: SunJCE 
version: 1.2 
string: SunJCE version 1.2 


PROVIDER # 3 
Corbett version 1.@ 


info: Provider For Dr. Dobb's Article 


name: Corbett 
version: 1.0 
string: Corbett version 1.0 





Example 3: Output of ListProviders after adding a provider. 
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(continued from page 42) 

e processByte() simulates the behavior of 
passing input through the contact on 
one side of a rotor, through the inter- 
nal cross wiring, and out through the 
contact on the other side. 


Another important component was the 
reflector, a nonrotating disc with contacts 
on one side only. Randomly selected 
pairs of contacts were wired together. 
The circuitry of the Enigma machine was 
such that when an electrical current ex- 
ited the last rotor, it passed through a 
contact on the reflector and out through 
the contact’s partner to begin its journey 
back through rotors three, two, and one, 
and on to a lamp board where it illumi- 
nated a lamp corresponding to some let- 


ter of the alphabet. The illuminated let- 
ter was the result of the encryption. 

Listing Three is EnigmaReflector.java. 
Just as the wiring of Enigmakotor was 
performed by the constructor, such is the 
case with EnigmaReflector. The wired 
pairs of contacts are stored in an array. 
The single method reflect() takes the in- 
teger value of a contact and returns the 
integer value of the contact to which the 
input contact is wired. 

The original Enigma machine was 
equipped with one additional option- 
al component— the Steckerboard, a 
plugboard that caused the swapping 
of pairs of letters before they were sent 
to the scrambling unit. I didn’t imple- 
ment this component, but doing so 
would be trivial. 
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Listing Four is EnigmaMachine.java, 
which represents an Enigma machine con- 
structed from the components just de- 
scribed. The construction of the machine 
from the components is performed by the 
constructor. The single method process- 
Byte() takes as input a single byte, pass- 
es it through the three rotors, through the 
reflector, back through the three rotors in 
reverse order, and returns the resultant 
value. Listing Four includes the code that 
catches EnigmaRotorTrippedException and 
advances the next rotor. 


The Java Cryptography 

Provider Architecture 

The Java provider package contains one 
or more engine classes (classes that pro- 
vide the functionality of a specific algo- 
rithm). MessageDigest, Signature, KeyPatr- 
Generator, CertificateFactory, KeyStore, 
AlgoritbmParameters, AlgorithmParame- 
terGenerator, and SecureRandom are en- 
gine classes. I'll limit my discussion to the 
Cipher class. As an application program- 
mer, you create an instance of Cipher 
and invoke its methods when you need 
to use a Cipher. Other than specifying a 
cryptographic algorithm when you cre- 
ate the instance, you don’t need to know 
what goes on under the covers; you work 
with concepts and trust someone else to 
handle the implementation. As the first 
step in creating your own provider pack- 
age, I’ll examine how you build the 
bridge between a concrete implementa- 
tion and conceptual functionality. 

In the same package where you find 
Cipher Gavax.crypto.Cipher), you will 
also find the CipberSpi class, which de- 
fines the Service Provider Interface (SPD 
for the Cipher class. Any service provider 
who wishes to supply an implementa- 
tion of a particular cipher algorithm must 
do so by implementing all of the abstract 
methods in the CipherSpi class. There 
are 11 such methods. Enigma java (avail- 
able electronically; see “Resource Cen- 
ter,” page 5) is a subclass of CipherSpi. 
The methods beginning with “engine” 
are those from the SPI. The overloaded 
method enginelnit() creates instances of 
Enigmakotor and Enigmakeflector and uses 
them to create an instance of Enigma- 
Machine. The difference between the two 
enginelnit() methods is that one is algo- 


Table 1: Comparison of methods in 
CipherSpi and Cipher. 
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rithm independent and the other— the 
one that takes an argument of type Al- 
gorithmParameterSpec— is algorithm spe- 
cific. AlgorithmParameterSpec is an in- 
terface that has no methods or constants 
but can be used in whatever manner the 
implementer deems necessary. You can 
see that EnigmaParameterSpec.java (avail- 
able electronically) implements this in- 
terface as well as the EnigmaParams in- 
terface (also available electronically) and 
is used to pass arrays of notch positions 
and start positions to the algorithm-spe- 
cific engineInit() method. The over- 
loaded methods engineDoFinal() and 
engineUpdate() perform the actual en- 
cryption. You now have a provider 
(based on my earlier definition of a 
provider as a package that delivers a con- 
crete implementation of a cryptographic 
facility). 

Now, from a functional point of view, 
let’s look at using a Cipher in a program. 
You can do so by examining Enigma- 
Test.java (available electronically), which 
is the small program I used to test my im- 
plementation of the Enigma machine. The 
line cipber = Cipher getInstance("Enigma", 
Corbett"); creates an instance of Cipher. 
As you can see by the absence of the new 
keyword, a constructor is not used; in- 
stead, the static method getInstance() is 


invoked. A static method that returns an 
instance of a class is known as a “factory 
method.” The instance of Cipher created 
and returned by the factory method en- 
capsulates an instance of a subclass of Ci- 
phberSpi. Table 1 compares the methods in 
CipherSpi to the those in Cipber. For any 
method invoked on an instance of Cipher, 
the instance invokes the corresponding 
method on the instance of CipherSpi, which 
it encapsulates. Therein lies the secret of 
the bridge between a concrete implemen- 
tation and conceptual functionality. 


Installing and 

Registering the Provider 

Every Java Virtual Machine contains one 
or more providers and each is represent- 
ed by an instance of the Provider class. 
The final class Security keeps track of all 
the providers in the JVM. Compile and 
run ListProviders.java (available electron- 
ically). When executed on my system, it 
produces the output in Example 1. The 
first provider listed (SUN) is the default 
provider that is delivered with the JDK. 
The second (SunJCE) is the one delivered 
with the Java Cryptography Extension. Pick 
any Java program and run it specifying 
the option -verbose:class; you will see nu- 
merous messages displayed. Among these 
are messages that show the providers be- 





ing loaded as the Java Virtual Machine is 
started. On my system, I see the follow- 
ing two messages displayed: 
[Loaded sun.security.provider.Sun from 
c:\jdk1.2beta4\jre\lib\rt jar] 
[Loaded com.sun.crypto.provider.SunJCE] 


It would seem, then, that the next or- 
der of business is to provide a mecha- 
nism whereby your provider is loaded. 
This mechanism can be found by ex- 
amining the file java.security, which is 
located in the directory jre/lib/security 
relative to the directory in which the JDK 
was installed. In this file, you’ll find the 
statement: security.provider. 1=sun.secu- 
rity.provider.Sun, which follows the for- 
mat security provider.<n> = <className> 
(<n> is the preference order and <class- 
Name> is a subclass of the Provider class 
whose constructor sets the values of var- 
ious properties that are required for the 
Java Security API to look up the algo- 
rithms or other facilities implemented by 
the provider). 

In Corbett.java (available electronical- 
ly), the constructor first calls superO and 
since the class is a subclass of Provider, 
an examination of the javadoc docu- 
mentation for Provider reveals that the 
parameters are a unique provider name, 
version, and long name. The effect is to 
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register version 1.0 of a provider whose 
name is “Corbett” and whose long name 
is “Provider for Dr. Dobb’s Article.” Fol- 
lowing the call to super, the constructor 
invokes the put() method to map the 
key “Cipher.Enigma” to a package name. 
If you look back at Enigma.java (avail- 
able electronically), you will find the 
package name in the first line of code. 

To make the package available, cre- 
ate a JAR file (enigma.jar), containing 
all the classes. To verify that you have 
not missed anything, run the command 
jar -tv enigma.jar. It produces Exam- 
ple 2. To cause the Provider class in this 
package to be loaded when the Java Vir- 
tual Machine starts up, add the line secu- 
rity.provider.3 =com.beechwood.crypto 
provider.Corbett to the java.security file. 

You can verify that things are okay up 
to this point by running the ListProviders 
program again. This time it should pro- 
duce Example 3. 


Putting it all Together 

If you run the program EnigmaTest.java 
(Listing Five), the following activities will 
take place: 


1. As the Java Virtual Machine starts, it 
reads the statement security.provider.3 = 
com.beechwood.crypto.provider.Corbeit, 


which you added to the java.security 
file, and the provider is loaded. 

2. The method main() executes the 
statement: cipher =Cipher.getInstance 
("Enigma", "Corbett"). The parameters 
are an algorithm (“Enigma”) and a 
provider (“Corbett”). The getInstance() 
factory method determines whether 
the named provider has been regis- 
tered. It finds the one that was regis- 
tered by Corbett.java (available elec- 
tronically). If the specified provider 
was not found, a NoSuchProvider ex- 
ception would be thrown. Next, the 
factory method determines whether 
the provider has mapped the named 
algorithm using a key of the form “Ci- 
pher.Enigma.” It finds the mapping 
created by Corbett.java and, based 
upon the mapping, it encapsulates an 
instance of Enigma and returns the 
Cipher object that contains this en- 
capsulation. 

3. The program invokes methods on the 
Cipher object to initialize it, to create 
ciphertext by encrypting a message, 
to reinitialize the object for decryption 
and to decrypt the ciphertext to yield 
the original message. 


Since this test program simply passes 
the encrypted message to itself for de- 


cryption, I did not address the issue of 
how to transmit the parameters required 
for decryption (that is, the passphrase, 
notch position, and start positions). This 
might be accomplished using authenti- 
cated Diffie-Hellman or a mechanism of 
your choice. 

Because encrypted messages almost 
always contain unprintable characters 
that can cause strange side effects 
when included in e-mail, they are usu- 
ally passed through a base64 encoder 
and decoded prior to use. A base64 en- 
coder and decoder are available elec- 
tronically. 


Conclusion 

The Java Provider Architecture facilitates 
seamless addition of algorithms, re- 
placement of one version of an algorithm 
with another by simply changing the 
provider name, and provides a cafeteria 
approach to components for the appli- 
cations programmer. Even though my 
discussion was limited to one crypto- 
graphic facility, you can apply the same 
technique to other facilities. 


DDJ 
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Listing One Becol nea skilled 
package com.beechwood.crypto.cipher; = 
import java.security.SecureRandom; ; Nn OWS 
public class EnigmaRotor { 

private int notchIndex; 

private int startPosition = @; 

private int currentIndex = @; 


private int[] b = new int[256]; 
private int[] f = new int[256]; 


rs de clic os feat without sitting in a classroom! 





this.notchIndex = notchIndex; 

oe Bee Learn ! 

int bx; 

Ue tos a cae: 8 at your own I si 
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SecureRandom r= new SecureRandom():; ((ttti(<Ct*~(CSstststststSSCd tat tnnnaennncannenecnencnnncnencnncnencnnc tenance 

r.setSeed (seed) ; 

ar. Dr. Dobb’s Journal 

for (int i = 0; i < 256; ++i) { Windows CE 


r.nextBytes(rb) ; 





bx = rb[@] & Oxff; . 
ie (fbx! < a) ¢ Programming 
ee CD-ROM teaches 
else { ; 
bx = (bx + 128) % 256; you how to write 
while (true) { et 
oe) compact efficient 
ie 
if, (bx) < 0) programs in C++ 
aii, using the Windows 
ee CE API. You get 
oo solid technical 
} : i ‘ ‘ a , 

) information with time proven instructional tech- 
protected void setStartingPosition(int startPosition) { niques— plus the comfort of selecting your learning 
this.startPosition = currentIndex = startPosition; ; t Q . fe graphics and bande an ab 

environment. Quizzes, - 
ae exercises insure that you become a skilled 
gah eines aess i Windows CE programmer. 


} 
if (currentIndex == notchIndex) { . ‘ 

eipey pew Bel pee ot oe Topped mecen tion inbyeh ats Dr. Dobb’s Windows CE CD-ROM will teach you how to: 
; notchIndex + " tripped"); 


} e Run Microsoft Visual C++ e Code menus, dialogue boxes, 
piokected dnt procauenyea(int 4. boolean Pocwacd) 1 Visual Studio to develop pro- property sheets, list views and 
int ri; grams for the Windows CE tree view controls 
int ix; , . A 
applications 
if (f a). £ 
be =U + cuctentiadad) ©2956; ¢ Respond to stylus clicks on 
: ri = b[ix]; e Download programs to ahand- __ the touch sensitive screen 
held PC for execution and : 
sere y debugging Adhere to Microsoft's User 
ri = (f[ix] - currentIndex + 256) % 256; Interface Guidelines for hand- 
—— ° Use the CE emulation held PCs 
} environment to execute a ; 
} ’ e Write installation scripts 


and debug programs 
eee NEW Price: 


package com.beechwood.crypto.cipher; 


public class EnigmaRotorTrippedException extends Exception { RELEASE! $44.95 





protected EnigmaRotorTrippedException() { System Requirements: 
super (); HARDWARE: ¢ IBM PC or compatible ¢ CD-ROM Drive ¢ 10 MB of free hard 
: disk space © 16 MB RAM or greater ¢ Soundcard and speakers (optional) 
pnOt ected Rat eaakoror Te ippedeacept tout str tngimag) 4 SOFTWARE: © Windows 95 or Windows NT 4.0 (or later) 
neers e Microsoft Visual C++ 5.0 (or later) 
} ¢ Microsoft Windows CE Toolkit for Visual C++ 
5.0 (or later) ¢ Adobe Acrobat Reader 3.0 (included) Adobe Acrobat 
Listing Three 


package com.beechwood.crypto.cipher; 
import java.security.SecureRandom; 
public class EnigmaReflector {( 

private int[] contacts = new int[256]; 


protected EnigmaReflector(long seed) { 
byte[] rb = new byte([1]; 
int[] mi = new int[256]; 
for (int i= @; i < 256; ++i) 
mif[i] = -1; 
SecureRandom r = new SecureRandom() ; 


(continued on page 49) 
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Winner of the Database Race. 


Ever wonder if there might be a 
new, powerful and easy-to-use database 
management system that can solve your 
performance and scalability problems? 

It's called Caché — the “post-relational” 
DBMS that offers advanced object technol- 
ogy, Web connectivity and faster SQL 
performance. Caché can do so many 
good things that it has won a prestigious 
international award as “the most exciting 


new database product”. 


“Dest New 
)kabase 


Caché is already in use today in hun- 
dreds of enterprises, ranging from small 
entrepreneurial companies to the world's 
largest client/server network. 

Caché is the latest database technology 
from InterSystems, the worldwide leader in 
high performance database products for 
transaction processing, with over 2,000,000 
users... and 20 years of database experience. 

This “best new database” is from a 


well-established company. 








-1998 Information Management Award Sponsored by Deloitte & Touche Consulting Group 


InterSystems » 


Ec CACHE 


POST-RELATIONAL DATABASE 


www.intersys.com m InterSystems Corporation m One Memorial Drive m Cambridge m Massachusetts m 02338 m 617.621.0600 
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r.setSeed (seed) ; 
int[] f = new int[2]; 
for (int i = @; i < 128; ++i) { 
for (int j = 0; j < 2; ++j) { 
r.nextBytes (rb) ; 
int ix = rb[@] &@x3f; 
while (true) { 
if (mi[ix] < @) { 
mil[ix] = 1; 
f[j] = ix; 
break; 
} 
t++ix; 
if (ix > 255) { 
ix = Q@; 
} 
} 
} 
contacts[f[@]] = f[1]; 
contacts[f[1]] = f[@]; 
} 


} 


protected int reflect(int i) { 
return contacts [i]; 
} 
} 


e e 
Listing Four 
package com.beechwood.crypto.cipher; 
public class EnigmaMachine { 


private EnigmaRotor[] rotors; 
private int rotorCount; 
private EnigmaReflector reflector; 


protected EnigmaMachine(EnigmaRotor[] rotors, EnigmaReflector ref) { 
this.rotors = rotors; 
rotorCount = rotors.length; 
reflector = ref; 


protected void processMessage(byte[] in, int inOffset, 
byte[] out, int outOffset, int len) { 
int ox = Q@; 
for (int i = inOffset; i < len; ++i) { 
for (int rotorIndex = @; rotorIndex < rotorCount; ++rotorIndex) { 
try { 
rotors [rotorIndex] .advance(); 
break; 
} 
catch (EnigmaRotorTrippedException erte) { 
} 


} 

int ic = ((int)in[i]) & Oxff; 

for (int k = @; k < rotorCount; ++k) { 
ic = rotors[k] .processByte(ic, true); 

W 

ic = reflector.reflect (ic); 

for (int k = rotorCount - 1; k >= @; --k) { 
ic = rotors[k] .processByte(ic, false); 

out [ox++] = (byte)ic; 


} 
} 


Listing Five 

package com.beechwood.crypto.interfaces; 

public abstract interface EnigmaParams { 
public int[] getNotchPositions(); 
public int[] getStartPositions(); 


public int getRotorCount() ; 


DDJ 
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WOOKIE: A 





68HC11 Emulator 





A Win32-based 
emulator 





Kalle Anderson, Jason Buttron, 
Paul Clarke, and Matt Enwald 


he Wireless Object-Oriented Kindly 
Interfaced Emulator (WOOKIE) is a 
freely available Win32 emulator for 
68HC11-based software develop- 
ment. When we designed and imple- 
mented the WOOKIE as a senior project 
at the Milwaukee School of Engineering 
(http://www .msoe.edu/), our goals in- 
cluded allowing program execution to 
start and stop at any time, even during 
ISRs. We wanted ease of use with a 
point-and-click GUI methodology. Most 
importantly, though, was our goal of ex- 
pendability. The WOOKIE needed to be 
developed in only six months, half of 
which was spent doing research and de- 
sign. Because of our time constraints, we 
designed the WOOKIE with an extend- 
able architecture to allow new modules 
to be added. In the end, all the 68HC11 
features we had planned on implement- 





The authors are graduates of the Milwau- 
kee School of Engineering. They can be con- 
tacted at kalle.a.anderson@lmco.com, 
jason buttron@plexus.com, pclarke@directs 
.com, or matthew.enwald@hksystems 
.com, respectively. 
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ing were completed, but the WOOKIE 
can be further expanded. 

In this article, we'll discuss both the 
development and use of the WOOKIE 
simulator. Source code and executable 
versions for the WOOKIE are available 
at http:// www.msoe.edu/eecs/ce/ceb/ 
resources/ and from DDJ (see “Resource 
Center,” page 5). This includes a user’s 
manual, programmer’s documentation, 
and a demo application. 





Designing the WOOKIE 

The WOOKIE GUI was written using Vi- 
sual C++ with MFC for Windows 95/NT. 
Some of the features we built into the 
WOOKIE include unique displays of I/O 
ports, registers, and memory. Other out- 
put devices, such as a 4x7 display and a 
pin scope, are also built in. We split the 
task of writing the WOOKIE into two ma- 


jor sections— the GUI and the 68HC11 
emulator core. Isolating the emulator core 
from the GUI created the possibility for 
another GUI to be written in a different 
platform, such as X Windows or Curses. 
We built a generic and flexible interface 
to integrate the GUI and the core with 
minimal connections. 

To create a platform-independent em- 
ulator core, we implemented the entire 
core in Standard C++. We used an object- 
oriented approach by creating base class- 
es for bytes and words. We decided not to 
use bit fields to represent the individual 
bits of bytes and words. The ANSIASO Stan- 
dard does not guarantee that bit fields will 
be ordered or packed in a consistent for- 
mat. In cases where we needed bit-level 
access, we called inline accessors and mu- 
tators. These inline routines use shifting 
and masking to manipulate the bits. 

One of the most difficult parts of the 
WOOKIE to design was the interface be- 
tween the GUI and emulator core. This 
interface provides the means for dis- 
playing run time changes to I/O devices. 
Because polling adds unnecessary over- 
head, we decided to make the visual dis- 
plays update asynchronously. To accom- 
plish this, we decided to implement 
display classes in the GUI that inherited 
from pure virtual classes in the core. Port- 
Connection (see Listing One) is one of 
these pure virtual classes. 

The display class in the GUI nol: 
ments graphical display changes by over- 
riding the Write function of the Port- 
Connection class. The emulator core calls 
the Write function when a port changes 
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In their April 6, 1998 issue, 
Computerworld asked StarTeam 
users and version control soft- 
ware users to discuss product 
capabilities and potential. The 
results speak for themselves: 
¢ “TI got more done in one day 
with StarTeam than I did in two 
weeks with the other products 
we evaluated.” 


e “Part of StarTeam’s beauty is 


Kevin Burden 


rowing interest in team develop- 
G ment adds a new clump of chal- 

lenges to application develop- 
ment. The risk of team members 
stepping on one another's toes increas- 
es with the number of developers shar- 
ing files. 

Enter software configuration manage- 
ment tools. 

Configuration management, which 
also is called change management, is a 
catch-all name for tools that address the 
challenges of team development. Those 
challenges include knowing which files 
are being worked on and by whom; 
needing to roll back to previous file ver- 
sions; tracking bug histories; and com- 
municating with other team members. 

Many development environments 
come with embedded tools to handle 
some of those tasks. But the problems 
with embedded tools become apparent 
when teams using multiple develop- 
ment environments work on the same 
project, says Al Smith, a senior systems 
analyst at T. Rowe Price Investment 
Technologies, Inc. in Baltimore. 

The tools 
don't always 
mesh, and 
there is no 
common view 
of the  proj- 
ect’s flow. 
More impor- 

“= tant, reliance 

on such tools 

may exclude 

key nonpro- 

grammers — 

groups such 

as marketing, 

quality assur- 

ance and end users. 

That’s where third- 

party programs such 

PVCS and StarBase 

Corp.’s StarTeam are intended to add 
value. They take different approaches to 
configuration management but are sin- 


wove» COMPUTERWORLD 


mi have rk 


Eight users of two different types of team 

development/configuration management tools 
report: The products have some challenges but are 
essential to a smooth development process 


gled out by analysts as examples of the 
products in the sector. 

PVCS comprises several products 
that address different aspects of change 
management and are sold separately. 
StarTeam comes as a fully integrated 
suite under a single interface. 

Both products are intended to adapt 
to your development process, which 
tells developers what files they can work 
on and when; neither is capable of set- 
ting one. 

These tools “can pull you out of a 
bind and fix problems. But without a 
process, you'll be in binds most of the 
time,” says Beth Ouellette, director of 
quality and enabling at The Prudential 
Insurance Company of Amcrica in 
Newark, N.J. 


USER VIEWS 

Computerworld asked four PVCS users 
and four StarBase users to discuss the 
products’ capabilities and potential. 


EASE OF USE 

As more nondevelopers take integral 
roles in the development life cycle, ease 
of use becomes critical for tools. The 
makers of StarTeam know this, and it 
shows in its interface, users say. But In- 
tersolv didn’t give ease of use the same 
attention, according to its customers — 
even experienced developers say PVCS 
is tough to use. Some of that can be ex- 
plained by the two vendors’ different 
philosophies toward project manage- 
ment. Intersolv’s PVCS relies more on 
centralized control to deal with prob- 
lems; StarBase emphasizes team collab- 
oration. 

“I got more done in one day with 
StarTeam than I did in two weeks with 
other products we evaluated,” says Todd 
Mancini, principal software architect at 
One Source Information Services, Inc. 
in Cambridge, Mass. 

Mancini says StarTeam seamlessly in- 
tegrates with his different development 
environments (Microsoft's Visual C++ 
and Visual Basic), but he prefers to use 
StarTeam’s interface over those of his 


development tools. 

“All I do in C++ now is code. Every- 
thing else — check in, check out, pro- 
ject management — | do in StarTeam’s 
interface,” he says. 

Part of StarTeam’s beauty is that all of 
its functions are integrated under one 
interface, compared with PVCS, whose 
products are separate. 

That integration leads to functional 
advantages. For example, bugs found 
through the defect tracking program 
can be attached to the exact problem 
file, helping quality assurance teams 
know what bugs to test for. “I’ve not 
seen another product that can do that,” 
says Mike Sly, technical manager at The 
Reynolds and Reynolds Co. in Dayton, 
Ohio. 

PVCS users clearly don’t share the 
same enthusiasm for its ease of use. “It 
has a horrible Windows interface,” says 
Harsh Kalra, a senior programming an- 
alyst at T. Rowe Price. Kalra says PVCS 
works “fabulously” through the com- 
mand line, but it could take weeks for 
contractors and new programmers to 
come up to speed. 

“We looked at PVCS but noticed it 
leaned too much toward the techie 
type,” says Starleam user Capt. Keith 
Kocan, program manager at the Stan- 
dard Systems Group in the U.S. Air 
Force in Montgomery, Ala. “The people 
that put together our user manuals 
need configuration management to co- 
ordinate all the documents, but they 
wouldn't be able to understand PVCS.” 


COLLABORATION 
StarTeam users communicate through 
threaded conversations. One team 
member starts a discussion by sending 
an E-mail message through StarTeam’s 
interface. StarTeam then automatically 
draws a relationship between the thread 
and project and tracks the initial mes- 
sage and its responses in a topic tree. 
Besides facilitating conversation, 
StarTeam documents those conversa- 
tions in a central repository. “If some- 
one has the same problem months lat- 


sailereration 


er, 
they 
can look 
up the con- 
versation and 
not have to go 
through the same steps again,” Sly says. 
PVCS doesn’t provide a means to 
document conversations. But it does of- 
fer a product called Tracker, which or- 
ganizes and manages project issues 
such as feature requests, defect reports 
and other changes in a database format. 
Developers can see the issues sur- 
rounding a project, but PVCS doesn’t 
provide a way for them to communi- 
cate. 
None of the four PVCS users inter- 
viewed are using Tracker.0 





Burden is a Computerworld features 
writer. 





The challenges of 
team deve 


Configuration management software aims 
to meet the challenges faced by team 
leaders and members alike 


Team leaders’ concerns: 
>» How can we capture ail the 
project-related information? 
»How do we manage widely 
dispersed teams? 

»How do we track the progress 
of our development efforts? 
» How can we tell when a prob- 
lem has been resolved? 

» How do we know when 
the project is ready for 
testing, quality assurance 
and production? 


Team members’ concerns: 
» What changes are assigned to 
me? 
» What are the priorities for 
making all these changes? 
>How do | inform others | have 
finished a change? 
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that all of its functions are integrated under one interface.” 


e “As more nondevelopers take integral roles in the development life 


cycle, ease of use becomes critical...The makers of StarTeam know 


this, and it shows in the interface, users say.” 


StarTeam encourages collaboration with features such as 


Location Transparency, so team members can access any type of 


file, from wherever they are. Use our Windows client, our Java 


client or your browser across LANs, WANs, the Web or the Internet. 


Visual Configurations eliminate the error-prone, time-consuming 
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process of using labels. 


Generalized Linking lets you 
link all the items in your 
repository in any number of 
ways to preserve context. Our 
File Management interface 
preserves the structure of your 
projects. And our integrated 
Defect Management and 
Threaded Conversations 
capabilities dramatically in- 
crease your team’s productivity. 

For current users of version 
control software, StarTeam 
provides a Collaborative 
Framework that interoperates 


transparently with PVCS, Visual 


SourceSafe or StarBase Versions™ archives. So now you can build 


Team Productivity on top of what you already have. 
But don’t take our word for it. Call us today at 888.STAR700 


or visit Www.starbase.com and we'll send you a reprint of the 


complete Computerworld article. Because when it comes to 


collaborative development, we let our users speak for themselves. 


StarBase® 
THE FUTURE OF TEAM PRODUCTIVITY IS HERE. 
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(continued from page 50) 

state. Because the Write function is im- 
plemented in the GUI, the display of the 
port is confined to the GUI. 

The memory map of the 68HC11 
varies between operation modes and 
chip models, so we needed to accom- 
modate a constantly changing memory 
map. We accomplished this by creating 
a MemoryMap class, where memory 
could be written to and read from. The 
MemoryMap consists of a linked list of 
MemoryObjects, each with its own im- 
plementation of Read and Write func- 
tions. The MemoryObject is a base class 
that represents a contiguous block of 
memory. Specific memory blocks, such 
as the registers and RAM, require their 
own classes derived from the Memory- 
Object class. The implementations of the 
Read and Write operations are then hid- 
den within the specific memory class. 
This way, even though writing to a reg- 
ister and to RAM is very different, the 
MemoryMap calls the Write routine of 
the associated MemoryObject. This de- 
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sign feature made remapping memory a 
simple operation. 

Program execution was an area where 
we definitely needed to keep overhead 
to a minimum. The best way to minimize 
overhead when calling an instruction 
from the vast collection of instructions 
was to create an array of function point- 
ers. The actual op-code value was the 
index into the function pointer array, 
thereby allowing instructions to be called 
dynamically. This method then requires 
a separate function to be written for ev- 
ery instruction. Although the instruction 
code is probably the most critical code 
to ensure an accurate emulator, the cod- 
ing work for these instructions became 
somewhat tedious. 

Another area of focus for our team was 
the timing. We had originally thought of 
having a general Clock function that 
would step the emulator along one clock 
at a time. We later decided against that 
idea because it required us to write each 
instruction in microcode. Instead, we cre- 
ated a general Step function that stepped 


Subject observers 


attach(Observer) 
detach(Observer) 


notify() o-------- : 


-7 value=v 


notify() 


_ Riswijk Institute of. 


l UL and GU, is an instruc- 
ie rstine of Pee He 


52 


soft’s COM specificatc mn, aN} 


Netherlands. We are now WOE on the ae 


THRSim11 Component Development Kit, 
which lets you develop your own com- 
ponents. These can then be connected to 
the pins, registers, and/or memory loca- 


the emulator through one instruction at 
a time. Since interrupts can’t barge in on 
a running instruction, we felt that the ex- 
ecution of the program would not re- 
strict timing resolution. To preserve the 
precise timing within the instructions, 
we wrote an internal_clock routine that 
each instruction would call when a clock 
period expired. As an example of our 
timing, Listing Two demonstrates the 
BRA (branch) instruction, which takes a 
total of three clock cycles to execute. 
The fetching of the op-code (outside the 
BRA instruction) expends one clock, so 
the BRA instruction is responsible for the 
remaining two clocks. 


Using the WOOKIE 

Now that we have explained most of the 
design of the WOOKIE, let’s get down to 
the actual operation. After launching, the 
WOOKIE is ready to accept a compiled 
S19 file. The listing file will also be read 
from the same directory and is displayed 
in the large window; see Figure 1. At pro- 
gram load time, the HC11 is reset. The 


update() 


process new value 
ConcreteSubject->get() 


and Design Patterns, oe ch 
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WOOKIE waits for users to enter the op- 
erating mode and starting address of ex- 
ecution. If users don’t remember the start- 
ing address, the WOOKIE finds it by 
parsing for the ORG command. If the pro- 
gram contains any variables using the RMB 
statement, then users may select “Load 
RMB Watches” from the Tools menu and 
all of the variables will be added to the 
memory-watch dialog window. 

The WOOKIE is just a simulator— it 
does not compile or link HC11 assembly 
or C programs (at least not currently). 
However, there are numerous free as- 
semblers, compilers, and linkers available 
for the HC11. These programs common- 
ly compile source code into a download- 
able file format called a “Motorola S-file.” 
In our case, an .S19 file is required to 
download code into the WOOKIE. The 
assembler we used is the AS11M assem- 
bler provided by Motorola. This can be 
downloaded free of charge from the Mo- 
torola or MSOE web site (see http:// 
www.imsoe.edu/eecs/ce/ceb/resources/). 
This assembler takes the user’s assembly 


ports, parallel ports, A/D converter, and 
the like.) The heavy use of the Observer 
pattern resulted in an application that con- 
sists of several components or modules 
loosely coupled together, Each component 
consists of several subjects and observers 
_ which can be connected to the observers 
and subjects of other components. This 
makes the THRSim11 68HC11 simulator 


program easy to extend. You can, for ex- 


ample, connect a simulated AND gate to 
the pins of the simulated 68HC11 as eas- 
ily as you can connect a real AND gate to 
the pins of a real 6@HC11. 

When we originally evaluated the Ob- 
server pattern, we asked the ees 
questions: 


e Since every ConcreteObserver has to 
call attach( )/detach() in relation to a 
Subject, can this responsibility that all 


Subject observers 


attach(Observer) 
detach(Observer) 


notify() o-.----.- : 


Model<T> | 


(component->*pointerToUpdateFunction)() 2 


return static_cast<Model<T>*> Dx 


(getPointerToSubject()) 


SLEEP TIT 

















Figure 1: Using the WOOKIE 68HC11 emulator. 


ConcreteObservers share be transferred 
to a common base class (Observer)? 

e Since every ConcreteObserever must con- 
tain a reference to the ConcreteSubject 
it observes, can this reference be defined 
in the common base class (Observer)? 

e Since every kind of ConcreteSubject 


must be derived from Subject, is it pos- 


sible to automate the generation of 
ConcreteSubjects? 

e If a ConcreteSubject being observed 
by a ConcreteObserver is destroyed, 
can we avoid the reference inside the 
ConcreteObserver becoming a dan- 
gling tcleicnce: ~—Cswst 

¢ If a ConcreteObserver observes more 
than one ConcreteSubject, the following 
problem arises: If the ConcreteObserver 
receives an update( ) call, it cannot de- 
termine the cause of this call. So the 
ConcreleObserver does not know which 


Observer 


subject} update() 
getPtrToSubject() 


for all o in observers { © 
o->update() 


CallOnWrite<T,C> 


| component 
|O update() : 2 
“| 0 Model<T>* operator->( 


“ l pointerToUpdateFunction | 


process new value E& 


| cow2->get() 


Example 2: The extended Observer pattern. 
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value it should update. According to 
Gamma and Helm, the solution to this — 
problem is to send along a parameter — 
with the update() call. This can be the — 
pointer of the ConcreteSubject that 
caused this update() call. But this leads _ 
to a switch statement inside the Con-_ 
creteObserver::update() member func- - 
tion to determine the cause of the up-_ 
date() call and take appropriate action. - 
This switch statement switches on an 
alarm bell inside our object-oriented _ 
minds because it is more often than not — 
a sign of improper object-oriented de- - 
sign. Is there another way to observe 

several ConcreteSubjects from within one 
Concrete-Observer? 


Example 2 illustrates how we extended 
the Observer pattern to answer “yes” to 
all of the aforementioned questions. As 
you can see, we moved the link from Con- 
creteObserver to ConcreteSubject to their 
base classes (from Observer to Subject). 
This makes it possible to avoid dangling 
references. The template Model<7T> can be 
used to generate a simple ConcreteSubject 
that encapsulates a value of type 7. The - 
template CallOnWrite<T,C> can be used 
to generate a kind of smart pointer to ev- 
ery Model<T> that a component C wants — 
to observe. We used Microsoft's COM to 
extend this pattern even further to make 
it possible to observe models from with- 
in other applications. More information, 
including all source code, is available at 


http://www.thrijswijk.nl/ ~bd/thrsimt1/ dad 
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Paceuncnn: 


code, assembles it into a .LST file and .S19 
file. The .LST file is a text file that con- 


Rider display on some of Port A’s LEDs, 
a real-time interrupt acting as a counter 


tains the user’s source code, coupled with 
the generated machine code. The .LST file 


is used by the WOOKIE to display and 
step through the assembly language 


on Port D, and Ports B and C being used 
to send characters to a 4X7 display. 

In the background, the real-time inter- 
rupt is being used to periodically increment 


code. The .S19 file contains the actual 
machine code to be downloaded to the 
HC11 with some header information such 
as where to put the machine code and 
a CRC. Usually, the .S19 file is used by 


a Boot Loader program that runs on a 


the value of Port D. By watching Port D 
change, users can observe the RTI run on 
the HC11. Listing Three is an example of 
the real-time interrupt and the ISR. The sole 
function of one process is to display char- 
acters to the 4x7 display. A group of pre- 
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PC and performs the physical download 
to the HC11. The WOOKIE requires that 
users have an .S19 file to download. If 
the .LST file does not exist, the simula- 
tor will still run, but no code will be dis- 
played while it is running. 

To start simulation, users may either 
step through the code line-by-line, or 
press the Go button to run the program 
at full speed. If execution is done at full 
speed, the program runs full blast with- 
out timing delays. The speed of the sim- 
ulator depends on the speed of the host 
computer. Users may also adjust the flow 
of program execution by changing the val- 
ue of the program counter in the MCU di- 
alog window. 

Many people enjoy stepping through their 
code line-by-line, but what happens dur- 
ing a timing loop? The WOOKIE supports 
breakpoints at any line of code so users 
don’t have to labor through loops. By 
putting the address of the desired line of 
code in the breakpoint text box, the pro- 
gram stops execution at that line. This is 
useful for debugging inside interrupt ser- 
vice routines. 

To handle I/O with the virtual HC11, 
users may utilize the I/O port dialog box- 
es and the IRQ and XIRQ pin buttons. Af- 
ter opening all the port dialog boxes, users 
can see the status of each port at all times. 
For the port pins that are configured as 
input pins, a left-mouse click on the pin 
toggles the pin high and low. To alter the 
active state of the LEDs, users must sim- 
ply press the Active High or Active Low 
button. This helps to impersonate hard- 
ware that inverts output signals. 


A Demo Program 
The rest of the WOOKIE’s features and 
functions are best demonstrated with a 
sample program. The sample program is 
called DEMO.ASM and was written for a 
project in an Operating Systems course. 
The program runs a multitasking kernel 
that schedules a maximum of eight pro- 
cesses at one time. Using this kernel pro- 
gram, we can write many different pro- 
cesses to do different things, allowing us 
to show eight different features of the 
WOOKIE at once. 

Some of the operations involved with- 
in the kernel program include: a Knight- 


viously loaded messages are used in our 
example program. Port C is used to hold 
the index of the character to be written and 
Port B holds the ASCII value of the char- 
acter to write. When the STRB pins go low, 
the display character is written out. 

Also using the 4x7 display is a pair of 
ISRs—the IRQ and XIRQ routines. By 
pressing the IRQ button, the IRQ be- 
comes active and fires the IRQ interrupt. 
The IRQ ISR takes over the function of 
the HC11 and displays “IRQ” on the 4x7 
display. By pressing the XIRQ button, 
the XIRQ ISR (see Listing Four) takes 
over the display ahead of the IRQ, and 
displays “XIRQ” on the display. Once the 
pins are deactivated again, regular op- 
erations continue. 

The IRQ and XIRQ are not the only 
pins acting as inputs. The I/O port in- 
put pins (or pins that can be setup to be 
inputs) work in the same manner as the 
IRQ and XIRQ buttons. By clicking on 
the LED icon of the port pin, the pin will 
toggle. Port A pin 7 is setup to act as an 
input. When this pin is set to high, the 
pulse accumulator interrupt fires and 
turns Port D into a running counter; see 
Listing Five. 

The WOOKIE also does a great job with 
pulse-width modulation functions. The 
kernel program has a process that sets up 
output compares OC1 and OC5 to toggle 
Port A pin 3 high and low, resulting in a 
square wave signal on that pin. Listing Six 
is the setup code. 

The square wave on Port A pin 3 can be 
viewed using the Pin Scope dialog window. 
Use the Attach button of the Pin Scope to 
monitor a specific pin. In this case, PA3 
should be monitored. Once the pin is cho- 
sen, the waveform begins to draw in the 
Pin Scope window. A slider bar is available 
to adjust the number of clock periods 
shown in the graph window. The Pin Scope 
also displays the current value of the peri- 
od, the frequency of the signal (according 
to a 2-MHz E-clock), and the duty cycle. 
The signal can be changed during simula- 
tion by simply changing the value of the 
TOC1 register. A value of BFFF will pro- 
duce a 75 percent duty cycle, 3FFF would 
make 25 percent, and so on. 


DD 
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OUND AOA ORINDA 


Listing One staa $1004 ;PORT B 


ldaa #1 
class PortConnection { staa $1003 ;PORTC 
public: ldaa 2,x 
virtual void Write(byte_t) = @; staa $1004 ;PORTB 
ldaa #@ 
staa $103 ;PORT C 
ldaa 3,x 
é-c6 staa $1004 ;PORT B 
Listing Two a 


// BRA instruction 
void HCi1:op_2@h(HC11 *hc11) // HC11 passed in oe ; 
{ // because function is static Listing Five 
signed char offset; 
he11->_clock(); PULSE_ACCUMULATOR_RTI: 
offset = (signed)hc11->memory [hc11->PC] ; inc $1008 ; increment PORT D 
he11->PC++; belr $1025 %@2010000 ; TFLG2 - Clear pulse accumulator flag 
he11->_clock(); rtd 
heii->PC = he11->PC + offset; 


Listing Six 


e e 
Listing Three LDX #$1000 ;Base address for registers 
ldaa #%00000011 ; Set up RTI to 32 ms BSET $20,x %00000G11 ;TCTL1: OC5 set high at TCNT=TOC5=@ 
staa $1026 ; PACTL BSET $23,x %10000000  ;TFLG1: Clear OC1F flag 
ldaa #%O19OO0OO BSET $OC,x %00001000 ;OC1M: Have OC1 control OC5 
staa $1024 ; TMSK2 - enable RTI interrupts BSET SOD, x %10900G0BB ;0C1D: Force 0C5 pin low at OC1 compare 
staa $1025 ; TFLG2 - clear RTI flag LDD #S7FEFF ;Since TOC5=90, setting TOC1 = $7FFF 
STD $16,x would give a 50% duty cycle 
rti_isr: 
inc $1008 ; increment PORT D 
ldaa #%0190G000 ; re-enables the RTI 
staa $1025 ; TFLG2 - 
rti ; return 
e e 
Listing Four DbDJ 
xirqstr fec "XIRQ' 
XIRQ_ISR: 
ldx #xirqstr 
ldaa #3 
staa $1003 ;PORT C 
ldaa @,x 
staa $1004 ;PORT B 
ldaa #2 
staa $1003 ;PORT C 
ldaa HP 
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Aspi Havewala 


f you’re an experienced Windows 

95/98/NT developer, you should feel 

right at home when developing Win- 

dows CE applications because the CE 
API is modeled after the Win32 API. But 
to say the Windows CE API is a subset of 
the Win32 API is slightly misleading. Even 
though the APIs are (for the most part) 
syntactically the same, the Windows CE 
API can be substantially different from the 
Win32 desktop platform. 

For instance, one difference between 
the two environments is that the Windows 
CE Platform SDK (available at http://www 
microsoft.com/windowsce/) includes a 
functional, albeit incomplete, emulation 
shell that mimics a Windows CE Hand- 
held PC (HPC) shell. This emulation en- 
vironment makes it possible for you to 
jumpstart development by prototyping ap- 
plications and, in some cases, develop 
large portions of code that will eventual- 
ly run on your target hardware. 

When designing applications, a ques- 
tion that is bound to pop up is whether 
you need to use MFC. Using MFC comes 
with a space penalty— an issue more im- 
portant with typical embedded apps than 
with desktop Windows applications. For 


Aspi develops system software for Windows 


platforms. He can be reached at ahavewala 
@hotmail.com. 
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instance, if you choose to use MFC, the 
retail version of the MFC DLL that needs 
to be included in your build takes up valu- 
able space (the retail version of mfcce20.dll 
for the x86 platform in Windows CE 2.1 
takes up about 287 KB). Whether you use 
the DLL is a decision you will have to 





make after determining how much ROM 
and RAM is available on the target plat- 
form. Developing a proposed memory 
map listing each module you plan to in- 
clude will simplify such choices. 

Still, the object-oriented MFC frame- 
work and tools that are part of Visual C++ 
(ike the ClassWizard) can save signifi- 
cant time. If your applications do not re- 
quire a user interface, MFC’s value is 
questionable. There are some utility class- 
es you can use, but your application will 
end up lugging a significant amount of 
code that deals with the GUI in mfc- 
ce20.dll and that you won’t use at all. 
MFC does ship with source code, so you 
can always look to see how Microsoft im- 


plemented features and use similar tech- 
niques. 

When using MFC, you can either link 
the MFC code statically, or have it ac- 
company your code in the form of a DLL. 
If you are developing new hardware and 
creating a custom version of CE, the sec- 
ond option is better. It results in slightly 
smaller applications, and the complexity 
of shipping the MFC DLL with your ap- 
plication can be addressed when you 
specify the files to include in your custom 
build of Windows CE. Having the MFC 
DLL in your build will make it available 
for other applications and services to use. 


Creating a Windows CE Application 
Assume you've decided to develop an MFC- 
based application for Windows CE. When 
you select the File | New menu in Visual De- 
veloper Studio, you'll see that the wizard 
choices available in the Project tab are: 


e WCE MFC ActiveX ControlWizard. 
e WCE MFC AppWizard (dll). 
e WCE MFC AppWizard (exe). 


These choices invoke MFC application- 
generation wizards. After asking you a se- 
ries of questions, the wizard generates a 
complete framework for an MFC applica- 
tion you can use. You can create either a 
DLL or an executable using the appropri- 
ate wizards. Apart from the application 
framework, the wizards also generate a 
complete build environment for the ap- 
plication. In this article, I'll discuss how 
to integrate this build into an automated 
build for the Windows CE Embedded 
Toolkit (ETK). 

On the bottom right side of the dialog 
box, you'll see a list of checkbox items un- 
der the title Platform. Windows CE runs 
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(continued from page 50) 

on a variety of hardware processors. To 
build your application for a particular pro- 
cessor, you use a cross compiler. The Win- 
dows CE Toolkit for Visual C++ ships with 
cross compilers for targets such as x86, 
SH3, MIPS, and Power PC. The list of 
checkbox items lets you specify builds that 
will target each of these platforms. If your 
application runs on a variety of platforms, 
you can select each from the list. These 
- compiler-specific builds are called “con- 
_ figurations” in Visual C++ Developer Stu- 
dio. You can switch platforms by switch- 
ing configurations and Visual C++ will 
figure out which cross compiler to invoke. 
(Actually, when creating your project for 
the first time, Visual C++ generates a 
makefile-like project file with a .DSP ex- 
tension which contains directives on how 
to build each configuration.) Finally, the 
linker is called with specific instructions 
on how to link the executable for a par- 
ticular platform. This is done by passing 
the /MACHINE option to the linker with 
_ any of the 1386, SH3, MIPS, or PPC flags. 


The Windows CE Emulator 

The Windows CE emulator, on the other 
hand, runs under Windows NT and emu- 
lates an HPC-like desktop complete with 
a shell and task bar. 

You can create a special build of the x86 
platform that lets your application run un- 
der the Windows CE emulator. Since the 
CE emulator can run on your x86-based 
workstation, you use the x86 compiler to 
compile your code. You then link to Mi- 
crosoft libraries created specially for emu- 
lation. For a Windows CE target, you pass 
the /subsystem:windowsce parameter to 
the linker. This tells the linker you are link- 
ing code compiled for CE. When linking 
for emulation, you pass the following flags: 
/subsystem:windows and /windowsce:em- 
ulation. Notice that the subsystem that the 
linker uses is regular Windows. 

For the bulk of its functionality, the em- 
ulator translates Windows CE calls into 
Win32 calls. In fact, for the most part, the 
applications that run under emulation are 
Win32 applications with linker modifica- 
tions that mimic some CE functionality. 
This is why you tell the linker the sub- 
system is Windows when building for em- 
ulation. 

Although it is a clever implementation 
shortcut, this design limits the extent to 
which the emulator models an HPC plat- 
form. The lesson here is that the emula- 
tor is a great prototyping tool, but as soon 
as you have your hardware available, run 
your application on it. Set aside some non- 
trivial time in your schedule for migrating 
your application to your target hardware. 
The amount of time you set aside depends 
on how much functionality remains to be 
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implemented because the emulator can- 
not support it. 

When you implement functionality that 
is not supported in the emulator, you will 
break your application under the emula- 
tor. To debug your application, you will 
need to download it to your target hard- 
ware. If your target hardware does not sup- 
port a true flash-file system that lets you 
refresh a newly built executable in ROM, 
you will end up bundling your application 
with the rest of the components to create 
a full build of CE before downloading it. 
This can be time consuming, especially 
when debugging via trial and error. The 
speed with which you can run your ap- 
plication under emulation, however, is lim- 
ited only by the speed of your processor 
and hard disk. In other words, download- 
ing your application to the emulator is near 
instantaneous. 

How can you develop under emulation 
if you need functionality not supported 
by emulation? You can’t. But, you can de- 
bug the user interface and calls that do 
work under emulation long after you’ve 
implemented functionality that breaks un- 
der emulation. Preprocessor conditionals 
are the preferred way to exclude code that 
you don’t want compiled for a certain 
build. For the emulation build, Visual C++ 
defines a preprocessor constant called 
_WIN32_WCE_EMULATION that can be 
wrapped around code you don’t want to 
compile for emulation: 


#ifndef WIN32_WCE_EMULATION 
// Do platform specific stuff that 


// won't work under emulation 
#endif 


By sprinkling your source code judi- 
ciously with constructs like these, you en- 
sure that your application will be avail- 
able for ongoing development and 
debugging on the emulator. (This constant 
is also used by the MFC code itself. The 
MFC run-time DLL, mfcce20.dll, is differ- 
ent for emulation than for a regular x86 
platform.) 


Configuring the Emulator 

Microsoft's documentation incorrectly states 
that, “to run emulation on your desktop 
PC, you must have Microsoft Visual C++ 
5.0 installed.” All you really need is the 
Windows CE Platform SDK. After installing 
the Platform SDK, you will find the emu- 
lator in \Program Files\Windows CE Plat- 
form SDK\Wce\Emul. 

Although the emulator is targeted for 
HPC applications by default, there is no 
reason you cannot prototype your appli- 
cation on it. You should be able to de- 
velop the user interface, any operations 
related to the object store, TCP/IP opera- 
tions, and registry operations. If you use 
the socket class for Winsock functionality, 


you won't be able to prototype that un- 
der emulation. The emulator pops up a 
nonmovable, nonresizable window that 
looks like the HPC desktop. The default 
dimensions for the desktop are the stan- 
dard 480x240 common to early versions 
of the HPC. You can change these by run- 
ning the control panel in the emulator 
(Start | Settings) and starting the Desktop 
Size applet. This applet lets you tailor the 
emulator desktop dimensions according 
to the size of the display you expect your 
hardware to provide. The desktop di- 
mensions are stored in your workstation 
registry under the key HKLM\Soft- 
ware\Microsoft\ Windows CE Platform 
SDK\Emulation\HPC\Screen Settings in 
the values SM_CXSCREEN and SM_CY- 
SCREEN. You can change these settings 
to make the desktop mimic your hard- 
ware form factor. The HPC shell, which 
provides the task bar and control panel, 
is not a standard component in the Win- 
dows CE ETK. In other words, you will 
either have to license the shell from Mi- 
crosoft separately or develop a shell of 
your own. For many devices, the HPC 
shell may not be appropriate. If you just 
have a single application running on your 
device (which provides the primary user 
interface), you may want to develop a 
minimal shell that registers itself as the 
desktop window and spawns your appli- 
cation. 

When you are working with Visual C++, 
Developer Studio (through the directives 
in the project file) does the grunt work of 
copying your application into the emula- 
tion object store and running it. Windows 
CE stores data in RAM in a format called 
the “object store,” which holds all types 
of application and data files, the system 
registry, and a small transaction-based 
database. The emulator maintains an ob- 
ject store in a file called “hpc.obs.” Think 
of this as your emulator’s file system. If a 
file including your application) must be 
made available to the emulator, it must be 
copied into the object store. Normally, 
since Visual C++ does this for you, you 
don’t need to worry about it. But what if 
you need to copy over some additional 
files that are required by your application? 
The way to do this is to use a program 
called “empfile.exe” that resides in 
\Program Files\Windows CE Platform 
SDK\ Wce\Emul\Hpc\Windows. Unfor- 
tunately, you won't know about these op- 
tions unless you scour the hard disk for 
interesting applications and invoke them 
with the “/?” option. Table 1 is a list of 
options that invoke EMPFILE. 


Developing Applications 

When developing apps, you'll come across 
instances of the Win32 API that are not 
supported in CE. For the most part, the 
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(continued from page 58) 
documentation is accurate, but there are 
exceptions: Named events are an exam- 
ple. The documentation consistently states 
that they are not supported, even though 
you can use named events in CE 2.0. If 
there is a critical piece of the Win32 API 
that is not supported under Windows CE, 
it is worth checking out. Look for updat- 
ed documentation on CE web sites that 
cater to developers, or ask around in one 
of the Usenet newsgroups that deal with 
CE development issues. 

On the emulator, Developer Studio sup- 
ports debugging using its standard de- 
bugging interface. The scenario is quite 
different, however, on your hardware. It’s 
important to understand how debugging 
will occur on your platform. The usual 
Windows CE setup uses a parallel and se- 
rial port. The parallel port is used to down- 
load code via a utility called “Ppsh” (or in 
CE 2.1, “Cesh”). Ppsh downloads the code 
to the hardware, then provides a 
prompt— a command line into CE run- 
ning on your hardware. Depending on 
your hardware platform, you will have to 
port Ppsh to your target. Microsoft pro- 
vides the source code for Ppsh in the ETK. 
When porting Ppsh, read the section ti- 
tled “Implementing the Parallel Port I/O 
Code” in the ETK online help. 

If the parallel port on your target plat- 
form supports bidirectional communica- 
tions, you can use a modified NULL par- 
allel cable to download code and 
communicate between your development 
workstation and target. In this case, you 


don’t have to port Ppsh. Although Red- 
mond Cable (http://www.redcab.com/) 
sells this modified cable, an alternative is 
to buy a 25 pin jumper box and, provid- 
ed you have the equipment, exercise your 
soldering abilities. Table 2 provides a sam- 
ple pin out for jumper-box implementa- 
tions. You can use Ppsh commands to 
query the status of processes and threads 
on your system and manipulate zone de- 
bugging. If your device has an ethernet in- 
terface, you can debug entirely through 
this interface on CE 2.10. 


Zone Debugging 
Zone debugging uses macros to catego- 
rize the types of traces you want your ap- 
plication to return. For example, you may 
want to send out certain traces during nor- 
mal operation. Other traces may be dis- 
played only if you want to see a higher 
level of detail. Some traces may apply only 
to validating parameters, others may sim- 
ply provide information. When debug- 
ging, you may want to look at traces per- 
taining to certain conditions without 
having to look through all the traces out- 
put by your application at run time. You 
can do just that with debug zones. Listing 
One presents a typical use of debug zones. 
In its first parameter, dpCurSettings holds 
the name of your application. Then, in an 
array of strings, it holds the name of each 
debug zone you are setting up. The zones 
in Listing One are used to output normal 
traces, traces with high level of detail, 
traces for critical conditions, traces relat- 
ed to initialization of your data structures, 


ualifiedPath\F Filename F FullyQualfiedPath Fil er 
ect store onto your harddisk.  ~—s  —r—_O_ON 


on arguments: Used to run your application. This ho you 
le into the object store first. Each time you invoke EMPFILE, 
nts, you will see the emulator pop up. Here's how you would 
ur aie object store so that your suse oR can find it 





Table 1: Options for Invoking EMPFILE. 
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and any traces related to the setup and 
use of timers in your code. (The assump- 
tion here is that your code uses timers, 
but it could be just about anything else.) 

The final parameter in dpCurSettings 
holds a bit-masked variable. Each bit that 
is set in this variable indicates a particu- 
lar zone that is activated. In other words, 
traces that belong to this zone will be sent 
to the debugger. I have activated zones re- 
lated to normal, critical, and timer-related 
traces. You may elect to see all traces in 
your application. Simply set the bit mask 
accordingly. 

Early in the execution of your code, you 
need to register zones with the debug sub- 
system of the CE kernel. You do this by 
calling the macro DEBUGREGISTER (Get- 
ModuleHandle(NULL));. Once your zones 
are registered, you can return traces as in 
Listing Two. 

The first parameter passed to DE- 
BUGMSG is the debug zone that the trace 
belongs to. In this example, you won't see 
the first trace from DEBUGMSG, but you 
will see the second one because I turned 
off the Initialization zone in the code. 

You can also use a macro called RE- 
TAILMSG to display traces. This macro 
works the same way as DEBUGMSG but in 
the retail build. Recalling the retail build re- 
quires WINCEDEBUG to be set to RETAIL. 
This can be useful when you need to de- 
bug those pesky problems that only crop 
up in the retail build of your software. 

MFC also provides macros for traces 
and assertion conditions. These can be 
used freely and work the same way as 
traces generated by DEBUGMSG. Howev- 
er, there is no support for zones. Use of the 
MFC macro ASSERT is recommended be- 
cause it lets you instantly debug your point 
of failure when you select the Retry button 
on the assertion dialog box. 

Once your zones have been registered, 
you can turn them on/off programmati- 
cally. The real value of zones are when 
you want to turn them on/off interactive- 
ly while the program is still executing. You 
do this using the gi and zo commands that 
are supported by the Ppsh prompt. 

The gi command lists all modules, pro- 
cesses, and threads running on your sys- 
tem. The index of each module is what 
you will need to use when manipulating 
zones interactively. The zo command lets 
you turn zones on/off. You need to know 
to which bit each zone corresponds. In 
the example discussed here, ZONE_NOR- 
MAL corresponds to bit 0, ZONE_DE- 
TAILED to bit 1, and so on. 

Say you want to turn on a detailed trace, 
but want to stop looking at trace messages 
related to timers. First, at the Ppsh prompt, 
type gi and you will get output similar to 
Listing Three. The sample application is 
listed as a process with ID 6. If you wrote 
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a DLL for use with your application (say, 
Sample.dll), it would show up as a mod- 
ule with ID 1. Armed with this infor- 
mation, you can turn on detailed traces 
and turn off timer-related traces in your 
application by using the zo command 
with the options: zo p 6 on 1, off 4. This 
command can be translated as such: For 
the process with index 5 in the system, 
turn on bit 1, and turn off bit 4. Recall 
that the active zones are specified using 
a bit-masked variable. Bits that are 
turned off correspond to zones that are 
deactivated. Similarly, bits that are turned 
on correspond to zones that are activat- 
ed. In the example, I activated ZONE 
_DETAILED and deactivated ZONE 
_ TIMERS. 
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To add your application to the list of files 
that get built into the binary ROM image, 
you will need to edit the file \WinCE\Pub- 
lic\ DDJSampleProject\ Files \Project.bib. This 
Binary Image Builder (BIB) file requires en- 
tries similar to Listing Four. 

The file Project.bib specifies which mod- 
ules and files get added to the binary im- 
age for your project. There is a cor- 
responding file, called “Platform.bib,” which 
resides under the \WinCE\Platform tree. 
This file specifies which files are added to 
the binary image for the platform. 

The conditionals are based on environ- 
ment variables you set prior to invoking the 
CE build. These conditionals are used to 
create a modular build, where certain com- 
ponents can be left out, if desired. Although 
your project may always include the ap- 
plication you just developed, these condi- 
tionals are used as an example. Besides, it 
is sometimes helpful when debugging your 
hardware to leave certain components out. 
There may also be a case for cutting down 
on download times for codevelopers who 
are not using your component and thus 
don’t need it in the binary image. 

The DDJ_COMMCTRL environment 
variable is used to indicate whether the 
common controls DLL (CommCtrl.dll) is 
added to the binary image. If you are 
using the Windows CE common controls 
(such as the tree view, list view, tabbed 
dialog boxes, and so on), you will need 
to add this DLL. Similarly, DDJ_APP, 
DDJ_MFC, and DDJ_OLE are used to con- 
ditionally add your application. You add the 
MFC DLL and OLE DLL only if you are us- 
ing them in your application. 

What about nested conditionals within 
the DDJ_MFC and DDJ_OLE conditionals 





Table 2: Sample. pin out for. jumper- 7 
box cable implementations. 
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(continued from page 62) 
that appear in the file? The MFC and OLE 
DLLs have different names for retail and 
debug versions. For example, the retail 
version of the MFC DLL is named Mfc- 
ce20.dll, while the debug version picks 
up an extra “d” in its name (for “debug”), 
mfcce20d.dll. The same applies to the 
OLE DLL Olece20.dll. The BIB file will 
need to know which DLL to bundle into 
the ROM image, depending on whether 
you are creating a debug or retail build. 
The Windows CE build process uses a 
variable called WINCEDEBUG to deter- 
mine whether a debug or retail build is 
being created. WINCEDEBUG is set to 
either DEBUG or RETAIL to signal a de- 
bug or retail build, respectively. When 
checking for the value of an environment 
variable inside a BIB file, you need to 
use an underscore in front of the vari- 
able name. This is an undocumented 
quirk of the BIB file preprocessor 
(Makeimage.exe) that can trip you up. I 
created a variable called _DDJDEBUG, 
which I set according to the value of 
WINCEDEBUG. This variable is then used 
in the BIB file to switch between the de- 
bug and retail versions of the DLL. 
When testing your BIB file changes, check 
the output of the ROM image builder, Romim- 
age.exe. Newly added files should appear in 


the list of files that Romimage spits out when 
creating a binary image. This check can save 
you headaches later. To understand why, you 
need to know about a feature built into the 
parallel-port download utility (Cesh.exe). Af- 
ter the download is finished, your binary im- 
age will attempt to establish a connection 
with the debugger (Windbg.exe) running on 
your workstation over the serial, parallel, or 
ethernet port (assuming you have created a 
debug build of the binary image). After a 
connection has been established, CE will load 
the modules required to run with the oper- 
ating system. When doing this, if it cannot 
find a module in the binary image, the de- 
bug build of the Windows CE loader will ask 
Cesh to load the module for it. If your mod- 
ule’s file exists in your \WinCE\Release di- 
rectory, Cesh will comply with the CE load- 
er’s request and download the file 
dynamically. You will see a degradation in 
boot speed and the kernel will send a de- 
bug trace to WinDbeg telling it that it has used 
Cesh to load a module. However, it is easy 
to overlook the degradation in boot time, es- 
pecially if your module is fairly compact, and 
it is equally easy to lose the corresponding 
trace among the several hundred traces that 
get output to WinDbg when a debug build 
is being executed on the target platform. 
The feature is neat, but it creates a prob- 
lem. When you successfully build a mod- 


ule, it will be copied to the \WinCE\Release 
directory either by the Build command when 
the environment variable WINCEREL is set 
to 1, or by the utility Buildrel bat. If, for some 
reason, you forget to add your files to the 
BIB file (or worse, your additions to Pro- 
ject.bib are not working correctly), you may 
not notice it. When your module is not 
found in the binary image, the Windows CE 
loader will use Cesh as its silent accomplice 
and load your module. You won’t realize 
what’s going on until much later, when you 
finally flash a retail image into ROM and 
there is no Cesh around to rescue a failure 
to load a module. 


Adding Your App to the Build Process 

Most modules that are added to the ETK 
build process are compiled with the Build 
utility. To use Build, create a SOURCES 
file that lists all your source files along 
with other information that Build uses to 
compile and link your module. After per- 
forming some housekeeping, Build calls 
Nmake with a file, called “Makefile.def,” 
as its argument that builds your code. 
Makefile.def contains directives on how 
to build ETK modules. However, Make- 
file.def does not support MFC applications. 
It doesn’t know where to find MFC head- 
er files and libraries. Moreover, the ETK 
Cefilter utility (which prunes header files 
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according to the components you have 
selected in your CE system) doesn’t know 
how to deal with MFC-related definitions. 
So, if your application uses MFC, you’re 
better off doing something else, at least 
until Microsoft adds MFC support to the 
ETK build process. 

The most straightforward way to inte- 
grate your MFC-based application into the 
ETK build process is to bypass Build en- 
tirely. Visual C++ Developer Studio has a 
menu option that lets you generate a 
makefile from project files. You may re- 
call that project files are files with a .DSP 
extension and are used by Developer Stu- 
dio for information on how to build the 
program under development. This ex- 
ported makefile can then be plugged into 
your ETK build process. 

There are some gotchas when ex- 
porting makefiles using the Project | Ex- 
port Makefile...menu. When compiling 
and linking your code, Developer Stu- 
dio knows where to find your header 
files and libraries. When you export your 
makefile and run it from the command 
line, you’re on your own. You will have 
to set up include paths for header files 
and libraries in your target before you 
export your makefile. You can do this 
by using MSDEVDIR, the environment 
variable defined by the Visual C++ in- 
stallation process. A typical include path 
for an x806-related build is: 


$(MSDEVDIR)\..\Wce\Include\Wce200, 
$(MSDEVDIR)\..\Wce\Mfc\Include\Wce200. 


MSDEVDIR points to the \Program 
Files\DevStudio\ShareIDE directory. Visual 
C++ files for Windows CE are installed in 
\Program Files\DevStudio\Wce, hence you 
need to step back from the directory defined 
by MSDEVDIR to find your files. Of course, 
you could choose to install Developer Stu- 
dio and the Windows CE Toolkit for Visual 
C++ in completely different directories. The 
path specified earlier would then no 
longer be valid. In such cases, you will 
have to define your own environment 
variables that point to your installation 
of the Windows CE Toolkit for Visual C++ 
and use these instead of MSDEVDIR. 

To specify this path, you need to select 
the menu option Project | Settings. ..and then 
select the C/C++ tab. Select Preprocessor in 
the Category listbox. In the Additional In- 
clude directories, enter the path listed above. 
This same path needs to be entered in the 
Additional Resource Include directories Edit 
box under the Resources tab. Finally, set up 
your library path so that the linker knows 
where to find the libraries it needs to link 
to. Select the Link tab and select Input in 
the Category list-box. In the Additional Li- 
brary Path Edit box enter the path: 


$(MSDEVDIR)\..\Wce\Lib\Wce200\ Wcex86, 
$(MSDEVDIR)\..\Wce\Mfc\ Lib\Wce200\ 
Weceex86 


TT TT Teese 


Before you enter all this information, se- 
lect Multiple Configurations in the Settings 
listbox on the top left corner of the dia- 
log. This lets you enter paths for multiple 
configurations. You should check off all 
configurations except those related to em- 
ulation —Win32 (WCE x86em) Debug and 
Win32 (WCE x86em) Release. You will 
continue to build for emulation from De- 
veloper Studio and thus don’t need the 
paths for that configuration. 

When you export the makefile, the 
paths will be added to your C/C++ com- 
piler, resource compiler, and linker flags. 
Invoking the makefile from the command 
line will now work correctly. 

Finally, the Always Download option 
under the Build menu in Developer Stu- 
dio must be toggled off before exporting 
makefiles. When this option is toggled on, 
the exported makefile will contain direc- 
tives that will attempt to download your 
executable to a target platform. Of course, 
you don’t want this happening in the mid- 
dle of the build. Besides, the executable 
will follow a different route on the way to 
your hardware platform. 

For information on adding the make- 
file to the ETK build process, see my ar- 
ticle, “The Windows CE Build Process,” 
DDJ, August 1998. 
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Listing One 


// Set up some debug zones 


#define ZONE_NORMAL DEBUGZONE (@) 
#define ZONE_DETAILED DEBUGZONE (1) 
#define ZONE_CRITICAL DEBUGZONE (2) 
#define ZONE_INITIALIZATION DEBUGZONE (3) 


#define ZONE_TIMERS DEBUGZONE (4) 


IF DDJ_COMMCTRL 


commetr1.d1l $ (_FLATRELEASEDIR) \commetr1.d11l NK SH 
ENDIF 
FILES 

Name Path Memory Type 


DBGPARAM dpCurSettings = { L"SampleApp", 

{ 

L"Normal",L"Detailed",L"Critical",L"Initialization",L"Timers",L"Undefined", 
L"Undefined", L"Undefined",L"Undefined",L"Undefined",L"Undefined", 
L"Undefined",L"Undefined",L"Undefined" ,L"Undefined", L"Undefined" 


}, 
ZONE_NORMAL | ZONE_CRITICAL | ZONE_TIMERS }; 


Listing Two 


DEBUGMSG (ZONE_INITIALIZATION, (TEXT("About to display initial djalog."))); 
If (bFailedToInitialize) 
t 


DEBUGMSG (ZONE_CRITICAL, (TEXT("Initialization failed. 


Aborting application") )); 


return 1; 


Listing Three 


PROC: Name hProcess: CurAKY :dwVMBase:CurZone 
THRD: State :hCurThrd:hCurProc: CurAKY :Cp:Bp 
: . (stuff deleted) 
PG6: SampleApp.exe 2O@9ed446 DOOOGPOW4AD YeGWOOOO BOGPGOG15 
T Sleepg 207db676 209ed446 90000041 3 3 
T Blockd 209ed466 209f54e2 90000051 3 3 
. (stuff deleted) 
MOD: Name pModule :dwInUSE :dwVMBase:CurZone 
M01: Sample.d1l 8O8df638 O0OGOG15 SlaeG@OOO SBGPGOG15 
. (stuff deleted) 


Listing Four 


MODULES 
Name Path 
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Memory Type 


(_FLATRELEASEDIR) \SampleApp. exe 
(_FLATRELEASEDIR) \SampleD11.d11 


SampleApp.exe 
SampleD11.d11 

ENDIF 

IF DDJ_MFC 

IF _DDJDEBUG=DEBUG 
mfcce20d.d1l1 

ENDIF 

IF _DDJDEBUG=RETAIL 
mfcce2@.d11 

ENDIF 

ENDIF 

IF DDJ_OLE 

IF _DDJDEBUG=DEBUG 
olece20d.d11 

ENDIF 

IF _DDJDEBUG=RETAIL 
olece2@.d11 

ENDIF 

ENDIF 


i 


$ (_FLATRELEASEDIR) \mfcce20d.d11 


$ (_FLATRELEASEDIR) \mfcce20.d11 


$ (_FLATRELEASEDIR) \olece20d.d11 


$ (_FLATRELEASEDIR) \olece2@.d11 


DDJ 
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Interacting with the 
M-CORE architecture 





Tom Cunningham and 
Chad Peckham 


n API is generally thought of as a 
set of named entry points into a soft- 
ware abstraction designed for a par- 
ticular purpose. Microsoft’s MFC, for 
instance, comprises an API for accessing 
and manipulating Windows objects. The 
UNIX stdio library, on the other hand, is 
an API for buffering and formatting file 
contents. 

In the world of real-time and embedded 
systems, however, APIs are much different. 
While desktop APIs address desktop- 
oriented issues such as window manipu- 
lation, process management, and file/ 
database access, APIs for embedded and 
real-time systems tackle issues such as de- 
bugger interfacing, task management, and 
low-level device I/O. In fact, low-level APIs 
exist for almost every real-time OS system 
service. For real-time application develop- 
ers, APIs encapsulate and abstract the ca- 
pabilities of the device, making peripher- 
al devices more tractable and speeding 
development. For embedded tool builders, 
low-level APIs provide access to parts of 
the machine that would otherwise be dif- 
ficult or impossible to use. In this article, 
we'll discuss a pair of APIs that are typical 
of low-level programming interfaces in em- 
bedded environments— the peripherals li- 
brary and emulator-server library, both for 
the M-CORE architecture from Motorola 
(the company we work for). 





The authors are engineers for Motorola. 
They can be contacted at tomc@lake- 
wood.sps.mot.com and cpeckham@lake- 
wood.sps.mot.com, respectively. 


68 






The M-CORE architecture is a 32-bit 
RISC design targeted for high-performance 
embedded applications requiring reduced 
system power consumption. M-CORE- 
based microcontrollers are particularly suit- 
ed to applications in battery-operated, 
portable products or highly integrated 
components functioning in extreme tem- 
perature environments. A wide array of 
peripheral devices can surround M-CORE- 
equipped microcontrollers, including 
timers, serial interfaces, A/D converters, 
network controllers, and even coproces- 
sors— all on a single piece of silicon. 


Device Drivers 

The concept of a device driver can vary 
depending on context. A UNIX device 
driver is a set of routines that is linked 
into the kernel and is designed to be ac- 
cessed in a rigorously controlled way by 
the operating system. In a real-time op- 
erating system (RTOS), device drivers may 
or may not be as rigidly defined or uti- 
lized. They may follow a particular pro- 
tocol, calling sequence, or interrupt con- 
vention, or they may only provide selected 
entry points to device functionality. 

In the M-CORE peripherals library, a 
device driver is an API that provides a cer- 
tain level of accessibility or service to a 
given device. At the lowest level, the API 


EMBEDDED SYSTEMS 


Low-Level APIs for 
Embedded Systems 








maps directly to device register control, 
essentially giving you a symbolic interface 
to the peripheral hardware. At higher lev- 
els a driver may support more sophisti- 
cated operations such as queuing, buffer- 
ing, sophisticated error handling, or 
application-specific processing. 

The M-CORE peripherals library, there- 
fore, takes a device-centric, bottom-up 
approach to driver design, rather than a 
host-centric model that relies on a spe- 
cific protocol for device interaction. Still, 
the intent of the library is to offer a uni- 
form interface for a wide range of pe- 
ripherals built around the M-CORE pro- 
cessor. The library consists of discrete 
levels of service, representing increasing 
degrees of device abstraction, which con- 
tribute a measure of uniformity to the pro- 
cess of peripheral access and control. 


Levels of Service 

The peripherals library module for a giv- 
en device can be viewed as a service in 
support of that device. Device services are 
categorized by the degree of device ab- 
straction that the service presents and the 
amount of interrupt processing support it 
provides. Library functions access device 
information through a device handle. The 
device handle is always the first parame- 
ter in any library call, but what the han- 
dle refers to will vary depending on the 
service level of the call. 

Level 1 services reside at the lowest lev- 
el; they interact directly with the hard- 
ware and return immediately to the caller 
(possibly with an indication that the re- 
quested action could not be taken due to 
the device being busy). The device han- 
dle in a level 1 call is always the base ad- 
dress of the memory-mapped device reg- 
ister block. 

Because it exists at the level of the 
raw hardware, a level 1 service has min- 
imal interrupt support, although a high- 
er level service employing interrupts may 
be built upon a level 1 service (see Fig- 
ure 1). The main benefit of a level 1 ser- 
vice is that it is symbolic: There are no 
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(continued from page 08) 

hardware register names or structures to 
remember, and parameter checking is also 
available. (All M-CORE peripherals library 
modules provide an interface to level 1 
services.) 

A level 2 service presents you with a 
more abstract model of a device than a 
level 1 service. It is generally built upon 
a level 1 service, although it may make 
use of optimizations unavailable to the ap- 
plication programmer (such as the inlin- 
ing of level 1 functions). An application 
program that uses a level 2 service would 
call only level 2 functions (although some 
of these may be simple passthroughs to 
lower-level functions). 


Be 


Figure 2: Level 2 service interrelationships 


0 


The device handle in a level 2 call is 
the address of a device descriptor. The 
device descriptor is a user-allocated 
block of storage that contains, at mini- 
mum, a pointer to the device hardware 
registers, and beyond that any other 
state information required to implement 
service functionality. Other possible 
components of a device descriptor 
might be: 


e A device completion flag to signal the 
application program logic. 

e A completion code accompanying the flag. 

e A buffer for a single datum. 

e A queue of data. 

e A structured message. 





eit 
aes 
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One device descriptor is created for 
each instance of a device associated with 
the service. An example of a level 2 ser- 
vice is a serial communications interface 

river implementing a buffered character 
ueue (see Figure 2). 


eripherals Library and RTOS 

The M-CORE peripherals library API does 
not necessarily conform to any standard 
set of device driver entry points for a par- 
ticular real-time operating system. In a 
sense, the peripherals library functions 
amount to device primitives that are 
pressed into service on behalf of a par- 
ticular OS driver model. The actual OS 
interfacing can vary from system to sys- 
tem, but at least two driver attributes are 
essential in any RTOS environment— in- 
terrupt handling and status signaling. 


Interrupt Service Entry. The M-CORE 
processor can support both vectored and 
autovectored interrupts. In the case of vec- 
tored interrupts, the address of a function 
is mapped directly to the vector space of 
the processor. For autovectoring, all in- 
terrupts are routed through the INT/FINT 
vectors in the processor vector space. The 
code executed as a result of interrupt pro- 
cessing is known as the interrupt service 
routine (ISR). 

To preserve generality for interrupt pro- 
cessing among all peripherals library mod- 
ules, the ISR can be implemented as an 
interrupt dispatch routine. The dispatch 
routine calls an implicit or explicit Inter- 
rupt Service Function (ISF) that performs 
the actual work associated with the inter- 
rupt. The dispatch routine can take care 


of a number of things in preparation for 
calling the ISF: 


¢ Sorting out among individual device 
hardware requests coming through the 
same vector. 

¢ Specifying the relevant hardware de- 
vice address or device descriptor for 
the given instance of a peripheral. 
This allows an interrupt service func- 
tion to be written independently of 
the hardware or descriptor address, 
and is therefore capable of servicing 
any number of like devices in the 
same system. 

e Serving as a wrapper for the interrupt 
service function— performing a nor- 
mal C-function call, receiving control 
back from the ISF when it is finished, 
and performing any postprocessing 
that may be necessary. 


For example, assume that there are 
two SCI devices on a chip, and two 
hardware vectors. Each of these will 
point to a single dispatch routine. The 
dispatch routine determines whether the 
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(continued from page 70) 

interrupt is for the receive or transmit 
channel. It also knows the descriptor 
address (device handle) unique to the 
hardware device being serviced, and 
passes this to the appropriate interrupt 
service function. 

Interrupt Status Communication. 
The interrupt service function may be 
either a routine explicitly designed for 
interrupt processing, or an API func- 
tion capable of performing the requi- 
site interrupt handling. When the ISF 
is called by the dispatcher it is still 
within the interrupt context, so there 
must be a way of communicating the 
ISF return status to the application pro- 
gram. This can be done by having the 
dispatcher call a Service Signaling Func- 
tion (SSF) upon return from the ISF. 
The SSF is passed to the return code of 
the interrupt service function, along 
with other pertinent parameters such 
as the device descriptor and any re- 
turned data. 

Separating the roles of interrupt service 
function and service signaling function 
makes it possible to use arbitrary API func- 
tions as ISFs, and provides for cus- 
tomization of the signaling function. The 
dispatcher as an interrupt service routine 
can be adapted to whatever interrupt 
mechanism is supported by the system 
hardware. Figure 3 illustrates the interrupt 
structure relationships. 


Implementation Issues 

The M-CORE peripheral library drivers 
are written in Standard C. The number 
and size of API functions is small enough 
per module that they are generally 
grouped into a single file and compiled 
as a unit. Because these routines operate 
at a very low level, they must be fairly ef- 
ficient with respect to code size and 
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Figure 3: Peripherals library interrupt structure. 


speed. Optimizing driver code, however, 
can be tricky. 

Listing One, for instance, is part of the 
receive routine in a level 2 driver for a 
UART. In the first line, the receive regis- 
ter (URX) is assigned to a local variable 
that is checked for certain status bits. If 
either the local variable or the UART reg- 
ister structure is not declared as volatile, 
optimized code may never reload the lo- 
cal variable from the receive register and 
the receive will always timeout. If the 
UART pointer is declared volatile, though, 
the generated code may be suboptimal 
due to unnecessary load and store oper- 
ations. 

A requirement of the peripherals li- 
brary API was to provide optional pa- 
rameter checking. This could have been 
done by having two versions of the li- 
brary, one with parameter checking code 
included and the other without. Sup- 
porting two separate libraries suggested 
maintenance headaches down the road, 
so instead all API entry points are de- 
fined as macros that eventually call the 
underlying library routine. The body of 
the macro contains preamble logic for 
performing parameter checks condi- 
tionally; see Listing Two. 

The documented API function is called 
UART_A_Receive, but the addressable 
function that performs the work is called 
UART_A_Receive_ jf The manifest constant 
UART_A_PARAM_CHECKING is defined 
in a global include file, but may be rede- 
fined to toggle parameter checking on an 
individual invocation of the macro/func- 
tion. If UART_A_PARAM _CHECKING is 
zero, the compiler ensures that code for 
the true action of the ternary operator is 
never generated. Conversely, if UART_A 
_PARAM_ CHECKING is a nonzero constant, 
the compiler generates code to perform 
parameter checking. All peripherals library 





API routines return a status. If parameter 
checking is enabled and there is an error, 
no function call is ever made; the result 
of the ternary operator substitutes for the 
function return value. 

This mechanism can be extended to 
support optional in-line code generation. 
In Listing Three, an interim macro is de- 
fined to check for in-line code expansion. 
If UART_A_INLINE_CODE is zero, the 
compiler will omit the in-line code gen- 
eration as an optimization and call the 
function directly. The parameter check- 
ing block examines UART_A_PARAM 
_CHECKING as before, but instead of call- 
ing the addressable function directly, it in- 
vokes the in-line code macro, which will 
either expand or eventually call the real 
function. 


Emulator Server Library 

All processors based on the M-CORE ar- 
chitecture have within the core an on-chip 
emulation (OnCE) circuit. This circuit pro- 
vides a simple, inexpensive debugging in- 
terface, allowing external access to the 
processor’s internal registers. The OnCE 
is controlled through a serial interface 
mapped onto a JTAG Test Access Port 
(TAP) protocol (IEEE-1149.1a-1993). The 
Emulator Server Library (ESL) facilitates 
OnCE debugging. 

The ESL is a set of processes and li- 
braries that provide a generic debugging 
interface that connects high-level appli- 
cations over various communication chan- 
nels to target devices. ESL attributes in- 
clude: 


e A set of generic APIs that cover all ba- 
sic debugging operations. 

e Communication over TCP/IP sockets 
with a low-level protocol module thus 
allowing cross-machine debugging. 

e Ability of more than one application to 
communicate with the same hardware 
simultaneously. 

e A Protocol Module Kit to enable third 

_ parties to construct custom low-level 
protocol modules. 

e A Protocol Module that is modularized, 
object-oriented designed, and easy to 
extend. 


Figure 4 illustrates how the ESL system 
is used. A client application communicates 
with the ESL, which in turn communicates 
with a development board. The client ap- 
plication and ESL reside on a host com- 
puter system. The connection path may 
be parallel, serial, or network. The con- 
nection device translates ESL back-end 
protocol commands into OnCE/JTAG se- 
quences. 

Three components make up the ESL— 
the API library, the protocol launcher, and 
the protocol modules. 
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e API library interface. The ESL, linked to 
the client application, consists of two 
interfaces—the API front end and 
TCP/IP back end. The API front end 
contains all the functions the applica- 
tion needs to communicate to the em- 
ulation hardware. The TCP/IP back end 
contains two sockets for communicat- 
ing with the launcher and the protocol 
module. All data contained in the APIs 
are reformatted into TCP/IP packets and 
sent to the Protocol Module. 

The protocol launcher daemon is a pro- 
cess that runs on the target machine. 
When the API library requests a proto- 
col process, the launcher first checks for 
a running module of the desired type. 
If found, the port number is returned 


to the API library; if not, the launcher 
spawns a new protocol module and 
passes back the port number. 

This process consists of two interfaces, 
one that interfaces with the API library, 
and another that interfaces with the pro- 
tocol module. When the protocol mod- 
ule is configured, all communications 
from the API layer go directly to it. The 
launcher monitors when new clients are 
connecting and when protocols need to 
be destroyed. 


e The protocol modules are where all the 


real work is done. They consist of three 
interfaces— a socketed front end, tar- 
get interface back end, and interface 
to the launcher. The front-end socket 
receives API messages from the API li- 
brary, makes calls to the corresponding 


A 


functions in the protocol, and returns 
results back to the library. The launch- 
er interface allows the process to noti- 
fy when startup initialization has com- 
pleted and when the process is shutting 
down. The target interface back end 
handles all communication with the de- 
velopment board. 

This ESL layer is extensible. A Proto- 
col Module Building Kit (available from 
Motorola) allows third parties to add 
protocol modules to communicate with 
different development boards. It pro- 
vides a socketed front-end binary ob- 
ject, base class for entry points, stubs 
for all API corresponding calls, and in- 
structions on how to build custom pro- 
tocols. 















Connecting to a Protocol Module 
Figure 5 illustrates the API library’s initial 
connection to the protocol launcher dae- 
mon. This occurs when the client appli- 
cation loads the API library Gin Windows 
95/NT) or when the ServerConnect API is 
called (in Solaris). 

The process boundary may be a ma- 
chine boundary. There is a configuration 
file associated with the API library that tells 
you where the launcher is. If the launch- 
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er resides on another machine, it must al- 
ready be running. If it is on the same ma- 
chine, the API library will launch it. 

The application then specifies a target 
type to the library. This causes the launch- 
er daemon to spawn the protocol mod- 
ule on the target machine; see Figure 6. 


Finally, after the protocol module is con- 


figured, the launcher returns a port num- 
ber to the API library. Communication is 
established between the API and proto- 
col; see Figure 7. 

Once the protocol module is config- 
ured, all communication to the evaluation 
board is direct from the API layer through 
the protocol module. When the client ap- 
plication disconnects from the API library, 
the launcher daemon terminates the pro- 
tocol module process, if no other clients 
are attached. 


ESL Examples 

Listing Four shows how you load and con- 
nect to a protocol module. The code loads 
the API library, loads pointers to the APIs 
it needs, then connects to the protocol 





Figure 6: Launcher spawns protocol 
process. 





Figure 7: Connection made to 
protocol module and M-CORE 
evaluation board. 
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module for the Enhanced Background 
Debug Interface (EBDD, a connection ca- 
ble that talks RS-232 to a host and trans- 
lates ESL protocol to OnCE sequences. 

Errors in loading or connecting should 
be handled here as well. For example, re- 
turn values from ServerConnect other than 
SERVER_READY are connection errors. 
Any return value from SetMCUInforma- 
tion other than SERVER_COMPLETE will 
be an error. 

Listing Five shows how you use the 
GetAsync API to process any target 
events. Whenever a call is made that will 
generate a run-state event in the target, 
Get-Async is called to process those 
events. For example, after Targetkeset, 
several events will be generated: Run 
state may change from go to stop and a 


en 


reset event will occur. Listing Five as- 
sumes that users have asked the debug- 
ger to do a “target reset” command. The 
ESLGetAsync pointer was loaded as in 
Listing Four. Processing event types usu- 
ally consists of updating memory display 
windows, register display windows, or 
code windows. 

Listing Six is part of a Win32 console 
application that tests download speeds to 
a development board. This is not the en- 
tire code sequence, but illustrates the use 
of the SetTargetMemory API. The ESLSet- 
TargetMemory function pointer was re- 
trieved as in the previous examples. 


DDJ 
(Listings begin on page 76.) 
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Listing One 
while (!((data = uart->URX) & URX_CHARRDY) && /* no data */ 


!(data & URX_ERR) && 
timeout != 0) 


if (timeout > 9) 
{ 
for G = @; i< delay; i++) 
/* ~1 us. busy-wait */ 
--timeout; 


} 


e e 
Listing Two 
#define UART_A_Receive (UARTPtr,Datap) 


(UART_A_PARAM_CHECKING) ? 

( 
((UARTPtr) == NULL) ? DD_ERR_INVALID_HANDLE : 
((Datap) == NULL) ? DD_ERR_INVALID_ADDRESS : 
UART_A_Receive_f (UARTPtr,Datap) 

) 


ge OOO GO, gO” Gh” Ge i” Gh 


UART_A_Receive_f(UARTPtr,Datap) 
) 


° e 
Listing Three 
#define UART_A_Transmit_m(UARTPtr, Data) 


(UART_A_INLINE_CODE) ? 
( 
!(((pUART_A_t) (UARTPtr))->USR & USR_TRDY) ? 
UART_A_ERR_DATA_PENDING : 
(((pUART_A_t) (UARTPtr) )->UTX = 
(Data) & (!(((pUART_A_t) (UARTPtr) )->UCR2 & UCR2_WS) ? 
SEVEN_BIT_MASK : EIGHT_BIT_MASK) , 
DD_ERR_NONE) 


POPE PP GP GP PE GPP PP KF 


UART_A_Transmit_f(UARTPtr , Data) 


) 
#define UART_A_Transmit (UARTPtr, Data) 
( 


ae ae 


"The compiler is really great and the st 
my whole life..." - Aschwin G. 


“GREAT, GREAT product. Keep up the good work!" - Craig N. 


- Larry O. 








“Fox 407 722 2 2902 


(UART_A_PARAM CHECKING) ? 
( 
((UARTPtr) == NULL) ? DD_ERR_INVALID_HANDLE : 
((!(((pUART_A_t) (UARTPtr) )->UCR2 & UCR2_WS)) && Data > 127) ? 
UART_A_ERR_INVALID_DATA_VALUE : 
UART_A_Transmit_m(UARTPtr, Data) 


aA A aA ZA A AA aA a 


UART_A_Transmit_m(UARTPtr , Data) 
) 


Listing Four 
#include "emusrvr.h" 


HINSTANCE hLibrary=NULL; 
PSERVERCONNECT ESLConnect=NULL; 
PSERVERDISCONNECT ESLDisconnect=NULL; 
PSETMCUINFORMATION ESLSetMCU=NULL ; 
PTARGETRESET ESLTargetReset=NULL; 
SERVER_RETVAL ret; 

BYTE bESLClientID; 


MCUINFO MCUInfo={@x49, 0x00); // Set CPUType = 0x40 


BOOL fConnected = FALSE; 


// Load API Library 
hLibrary = LoadLibrary ("Esrv32.d11") ; 
if (hLibrary) 
{ 
// Get pointers to APIs 
ESLConnect = (PSERVERCONNECT)GetProcAddress( hLibrary, 
cszSERVERCONNECT ) ; 
ESLSetMCU = (PSETMCUINFORMATION)GetProcAddress( hLibrary, 
cszSETMCUINFORMATION ) ; 
ESLDisconnect = (PSERVERDISCONNECT)GetProcAddress( hLibrary, 
cszSERVERDISCONNECT ) ; 
ESLTargetReset = (PTARGETRESET)GetProcAddress( hLibrary, 
cszTARGETRESET ); 
if (ESLConnect && ESLSetMCU && ESLDisconnect && ESLTargetReset) 
{ 


// Connect to EBDI 
ret = ESLConnect( NULL, "COMi", EBDI, &bESLClientID ); 
if (ret == SERVER_READY) 







- Ocie M. 


for most idee microcontol 





eee 


// Tell EBDI we want to do M*CORE 


fConnected = TRUE; if (( dwNextAddress != dwSrecAddress) |} (nDatalen > 5@8)) 
ret = ESLSetMCU( &MCUInfo, @, ®, bESLClientID ); { 
} // Address discontinuity or buffer full - download buffer 
} // before appending this s-record to buffer 
} if (nTotal) 
{ 


Li ti Fi // buffer has data 
IS Ing Ive dwGrandTotal t= nTotal; // running total of all bytes 

RESETSTRUCT Reset Ente tals = 

ASYNCSTRUCT Async ESLSetTargetMemory( @x@0, // bModifier = Target 

Qx@0, // bAdderSpace = @ (ignored) 


ret = ESLTargetReset( &Reset, bESLClientID ): Oxb2, a egy gerbes writes 
if ( ret == SERVER_COMPLETE ) cuter eaderes me 
nTotal - 1, // bytes to write 
ret = SERVER_ASYNC; a . ies ee 
while (ret == SERVER_ASYNC) // til N t piece ee 
i ( pene Saererenga, ene &dwErrorAddress, // Error address 
ret = ESLGetAsync( &Async, bESLClientID ); if (wESLS = ee // ESL ID 
if ( ret == SERVER_ASYNC ) // got one i enue, 7 


{0}; // Default= reset into debug mode 
{0}; // Storage for event structure 


' /} Process event types // Error writing target memory - notify user 
} printf("\nError writing address %@8.81X, nBytes = 
} %d, status = %d\n",dwCurAddress,nTotal,wESLStatus) ; 
} DoExit (); 
return (-1); 
} 
Listing Six // buffer now empty 
nTotal = 9; 
while (wStatus == CSrecord::srecordOK) dwCurAddress = dwSrecAddress: 
{ } 
wStatus = pSrecord->GetNextSrecord( &dwSrecAddress, } 
srecBytes, 256, &nSrecLen ); // Add this s-record to buffer and adjust length of buffer 
if (wStatus == CSrecord: :srecordOK) memcpy( buffertnTotal, srecBytes, nSrecLen ); 
{ nTotal += nSrecLen; 
if (fFirst) } 
{ } 


// Initialize current address for first s-record } 
dwCurAddress = dwSrecAddress; 
fFirst = FALSE; 
} 
if (nSrecLen) 
{ DDJ 
// s-record file not at end 
// check for address discontinuity or full buffer 
dwNextAddress = dwCurAddress + nTotal; 
nDatalen = nTotal + nSrecLen; // buffer plus this s-record 
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INTERNET PROGRAMMING 


Understanding 





A protocol for 
information retrieval 





Basit Hussain 


irectory services, which store and 

locate information about a system’s 

services, users, and applications, are 

an essential part of any operating 
system. Information needed for day-to- 
day operation is available from such a 
repository. Unfortunately, every operat- 
ing system provides its own mechanism 
of managing and retrieving information 
from its directory services. The Light- 
weight Directory Assistance Protocol 
(LDAP) is an Internet standard that has 
been embraced on UNIX and Windows 
NT and has won support from major ven- 
dors. Essentially, LDAP is a subset of the 
International Telecommunication Union’s 
(ITU) X.500 standard. In this article, I’ll 
examine LDAP and present examples of 
how it can be used. 

Primarily intended as a front end to the 
X.500 directory services, the LDAP evolved 
from work at the University of Michigan 
(see http://www.umich.edu/~dirsvcs/ldap/ 
index.html) and was eventually taken over 
by the Internet Engineering Task Force 
(IETF). At this writing, the current release 
of LDAP is Version 3, which is defined in 
RFC 2251 and several supporting RFCs. Most 
of the available implementations of LDAP 
are still based on Version 2, which is de- 
fined in RFC 1777. 


Basit is an Internet security architect at 
The Technical Resource Connection. He 
can be contacted at basit.hbussain 
@trcinc.com. 
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LDAP 


LDAP addresses supply the same set of 
services currently provided by Novell’s 
NDS, Solaris’s NIS+, and Microsoft’s Active 
Directory Server. It can also be used as a 
repository for such services as an enhanced 
security server that requires strong au- 
thentication on the part of the users. Un- 
der such conditions, LDAP servers can be 
used to store the user’s digital certificates. 


LDAP Directories 
The basic unit of information inside the 
LDAP database is an entry. The complete 


LDAP database can be classified as a col- 
lection of entries. An entry is comprised of 
a Distinguished Name and a collection of 
name-value pairs. The Distinguished Name 
is unique throughout the database and 
serves as the exclusive pointer for that spe- 
cific entry. The name-value pairs are used 
to store the information of interest for that 
entry. However, to explain the composition 
of an entry in more detail, it is essential to 
explore the two building blocks of the LDAP 
schemata— attributes and object classes. 
Attributes and object classes are defined 
in two schema files provided with the di- 





rectory server. The attributes file provides 
the names of the different attributes that 
eventually reside inside the LDAP entries. 
An attribute is classified as one of five types: 


e Case Insensitive String (cis). 
e Case Exact String (ces). 

e Binary Data (bin). 

¢ Telephone Numbers (tel). 

e Distinguished Name (dn). 


The types are self explanatory. The ma- 
jority of the attributes belong to cis types. 
The case can be important under certain 
conditions, for which the less frequently 
used Case Exact String (ces) type is used. 
Binary Data (or bin) may be comprised of 
encrypted passwords, digital certificates, 
and JPEG photographs. Telephone num- 
bers require special attention because 
spaces, parentheses, and hyphens are not 
supposed to change the meaning of the 
content. The dn attribute is the same as the 
one explained previously. 

The second schema file defines the ob- 
jectclasses that the directory understands. 
Each objectclass is comprised of several re- 
lated attributes. The objectclass definition 
classifies its component attributes as either 
required or optional. The required attributes 
must be assigned a value if an entry ex- 
pects to utilize an objectclass. The option- 
al attributes can be included or omitted on 
an entry-by-entry basis. 

An LDAP entry contains a Distinguished 
Name and a collection of name-value 
pairs. The name of the name-value pair 
comes from the schema file, while the val- 
ue is populated by assigning it content. 
For example, a popular attribute is the 
common name, also called cn, that can 
be assigned the value of “Bill Merchant” 
and represented as cn: Bill Merchant to 
construct the name-value pair. An at- 
tribute can have more than one value as- 
signed to it. Both cn: Bill Merchant and 
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(continued from page 78) 
cn: William Merchant are legal within the 
same entry, for example. 

The Distinguished Names, or the locators 
for any entry, are defined using a tree-like 
hierarchy. A typical Distinguished Name 
consists of three or four components, al- 
though that is not a restriction. Each com- 
ponent of the Distinguished Name is known 
as a “Relatively Distinguished Name.” An 
example of a Distinguished Name might be 
dn: cn=Bill Merchant, ou=System Adminis- 
tration, o=MicroWidgets Inc, c=US. 

The root of the tree is to the right and 
is represented by the c attribute that de- 
fines the country. At that point, a number 
of branches can exist, each representing 
an organization (the o attribute). The tree 
can branch off at that point to represent 
several organization units (the ow attribute) 
and each organizational unit can contain a 
number of persons identified by their com- 
mon name (cn). The aforementioned ex- 
ample depicts just one possible form of in- 
formation organization. 


LDAP Operations 

The majority of the operations conducted 
on an LDAP directory server are comprised 
of information searches. Other operations 
include adding new directory entries, mod- 
ifying existing entries, and deleting directo- 
ry entries. Listing One is an excerpt of test 
data that demonstrates this. (The complete 
test data file is available electronically; see 
“Resource Center,” page 5.) Listing Two is 
source code for searching, adding, deleting, 
and modifying entries. The code requires 
the LDAP Java SDK from Netscape, avail- 
able at http://developer.netscape.com/tech/ 
directory/software/dirifc/ljdkl0b3.exe. A di- 
rectory server is also needed, and a trial ver- 
sion can be downloaded from the Univer- 
sity of Michigan or Netscape. 

Listing One defines test data needed to 
populate the directory server. The data is 
formatted using LDIF (LDAP Data Inter- 
change Format). The consecutive entries 
are separated by a blank line. The root 
Distinguished Name of the tree is defined 
as o=Micro Widgets Inc, c=US. Further en- 
tries define the organizational units and 
people who belong to them. The first en- 
try requires extra attention, as it defines 
the people that are allowed to perform 
the modification operations. Usually, these 
permissions can be set in a more user- 
friendly manner through a user interface 
provided with the directory server. To test 
the source code, a new directory server 
needs to be created with a blank database 
and the LDIF file imported into it. This 
prepares the directory server for the op- 
erations performed by the source code. 

Before compiling and running Listing 
Two, the attributes dapHost and IdapPort 
must be updated to reflect the server host 


Dr. Dobb’s Journal, March 1999 


and port. A total of four methods are pro- 
vided that follow a pattern similar to 
connect-authenticate- operate- disconnect. 
To maintain the flow of the person perus- 
ing the source code, no additional private 
methods were created for connection and 
authentication. The main() method can be 
used to call each one of the operations in 
the order shown. 

The searchEntries() method connects 
to the LDAP server and performs a search 
to locate all the entries belonging to the 
organizational unit of Application Devel- 
opment. No authentication is required for 
this operation, as it does not alter any data. 
The search will retrieve a total of three 
entries (one for the ou and two for the 
persons belonging to it). It will print the 
Distinguished Name and all the attributes 
(name-value pairs) as a single string on 
the standard output. This is followed by 
the disconnection operation. 

The addEntry() method connects and 
authenticates itself as a Distinguished Name 
that is authorized to modify the LDAP 
database. This is followed by defining a new 
Distinguished Name and constructing a 
number of new attributes. The attributes 


The attribute set object is combined with 
the Distinguished Name to form the 
IDAPEntry object, which is added to the 
directory. If the searchEntries(.) method is 
executed again at this point, it will show 
the new entry. 

The modifyEntry() method operates on 
an existing entry and alters two of its at- 
tributes. It adds a new attribute street and 
alters the value of an existing attribute (/) 
to Siberia (initially Yukon). The deleteEn- 
try) method is the simplest of all. It deletes 
an entry from the directory server by ref- 
erencing it with its Distinguished Name. 


Enhanced Services 

The schema provided with the directory 
server is sufficient for the base functionali- 
ty expected from a directory server. How- 
ever, it can be extended to contain user- 
defined attributes and objectclasses if needed 
by the applications. To extend the schema, 
one must modify the attributes file to con- 
tain the new attributes and their types. The 
new objectclasses that expect to utilize these 
attributes are added to the objectclass file. 
Any LDAP entry can utilize the extended 
schema at this point by including the new 


SSS SSS SSS lessees 


Replication is not defined as part of the 
LDAP protocol, but it is supported by most 
LDAP vendors. This is a useful feature, as 
it provides fault tolerance against the fail- 
ure of a single directory server. Different 
LDAP servers can be set up as suppliers or 
consumers of either the complete LDAP 
database or any of the subtrees contained 
therein. The replication service is triggered 
at predefined intervals throughout the week 
in order to synchronize the directory servers 
working together. Other advantages of repli- 
cation include local control of subtrees with- 
in an organization and faster response time 
from search operations. 

Referral is an LDAP service that redirects 
an LDAP client to an LDAP server that is dif- 
ferent from the one initially handling the re- 
quest. This can happen when the client tries 
to modify an entry that has been replicated 
from another server. Since the source of such 
an entry is not the local server, the modifi- 
cation has to take place at the supplier be- 
fore it can be reflected locally. A redirection 
can also take place if the client requests an 
entry that does not belong to the root Dis- 
tinguished Name stored by the current tree. 





are successively added to an attribute set.  objectclass as part of its name-value pairs. DDJ 
Listing One import java.util.*; 
import java.io.*; 

dn: o=MicroWidgets Inc, c=US import netscape. ldap.*; 
objectclass: top catch (LDAPException e){ 
objectclass: organization . 
o: MicroWidgets Inc. System.err.println("Not connected") ; 
subtreeaci: +(&(privilege=write) (target=ldap:///self) ) } 
subtreeaci: +(&(privilege=write) (clientGroup=ldap:///cn=Directory 7. ; 

Administrators, o=MicroWidgets Inc, c=US)) public void addEntry () 
subtreeaci: +(privilege=compare) { 2 
subtreeaci: +(j (privilege=search) (privilege=read) ) LDAPAttributeSet lds = null; 

LDAPEntry lde = null; 
dn: ou=System Administration, o=MicroWidgets Inc, c=US LDAPConnection lde = new LDAPConnection() ; 
objectclass: top try 
objectclass: organizationalunit Idc.connect (ldapHost, IdapPort); 
ou: System Administration } : 
catch (LDAPException e){ 
dn: ou=Application Development, o=MicroWidgets Inc, c=US System.err.print1n("Connection Error") ; 
objectclass: top } 
objectclass: organizationalunit try 
ou: Application Development : ldc. authenticate (authDN, authPw) ; 
dn: ou=Project Administration, o=MicroWidgets Inc, c=US catch (LDAPException e){ : 
objectclass: top System.err.println(e.toString()); 
objectclass: organizationalunit 
ou: Project Administration tryl . , : 
String newdn = "cn=Bobby Windsor, ou=Application Development, 


o=Microwidgets Inc, c=US"; 
String[] attrlist= {"cn","sn","ou","objectclass","objectclass", 
"objectclass","objectclass","uid","userpassword","mail"}; 
String[] vallist={"Bobby Windsor","Windsor","Application Development", 
"top","person","organizationalPerson","inetOrgPerson", 
"bwindsor","tackit", "bwindsor@microwidgets.com"}; 
lds = new LDAPAttributeSet(); 
for (int i=@;i<attrlist.length;it++) { 
lds.add(new LDAPAttribute(attrlist [i] ,vallist[i])); 


dn: cn=Directory Administrators, 

en: Directory Administrators 

objectclass: top 

objectclass: groupofuniquenames 

uniquemember: cn=Bill Merchant, ou=System Administration, 
o=MicroWidgets Inc, c=US 

uniquemember: cn=David Builder, ou=Application Development, 
o=MicroWidgets Inc, c=US 


o=MicroWidgets Inc, c=US 


c=US } 
lde = new LDAPEntry(newdn,1ds) ; 
ldc.add(lde) ; 


dn: cn=Bill Merchant, ou=System Administration, o=MicroWidgets Inc, 
en: Bill Merchant 
sn: Merchant 


givenname: Bill : 
objectclass: top catch (LDAPException e){ 


objectclass: person System.err.println(e.toString()); 


objectclass: organizationalPerson } 
objectclass: inetOrgPerson try f : 
ou: System Administration Ide .disconnect () ; 
1: Yukon 
uid: bmerchant 
mail: bmerchant@MicroWidgets.com 
telephonenumber: +1 999 000 6084 
facsimiletelephonenumber: +1 999 @@0 6138 } ; : : 
userpassword: hackit public void modifyEntry() { 
LDAPConnection 1ldc = new LDAPConnection(); 
try{ 
lde.connect(1ldapHost, ldapPort); © 
} 


public class DirectoryTests { 


} 
catch (LDAPException e){ 
System.err.println("Not connected") ; 


Listing Two 


private String authDN = "cn=Bill Merchant,ou=System Administration, 


package ldap.directory; o=Microwidgets Inc,c=US"; 
import java.lang.*; (continued On page 82) 
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(continued from page 81) 


private String authPW = "hackit"; 
private String ldapHost = "r2d2.microwidgets.com"; 
private int ldapPort = 1389; 


public void searchEntries() { 
LDAPSearchResults ldr = null; 
LDAPAttributeSet lds = null; 
LDAPEntry lde = null; 


LDAPConnection lde = new LDAPConnection() ; 
try{ 
lde.connect (ldapHost, ldapPort) ; 


} 
ilies your : : system. ere print1n(*Comection error"); 
imaginationwith | cry 
knowledge. 7 a 


ldr= lde.search("o=MicroWidgets Inc, c=US",LDAPv2.SCOPE_SUB, 
"(ou=Application Development)",null, false) ; 


} 
catch (LDAPException e){ 
System.err.println(e.toString()); 


try{ 

while (ldr.hasMoreElements()) { 
lde=1ldr.next(); 
String ndn = lde.getDN(); 
lds=lde. getAttributeSet () ; 
System. out. print1n("\n\n"tndnt"\n") ; 
System. out.println(lds.toString()); 

; 


} 
catch (LDAPReferralException e) { 
//process referrals here 
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catch (LDAPException e){ 
System.out.println("Error connecting") ; 


: : ae |dooa } 
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lde.authenticate(authDN, authPW) ; 


System.err.println(e.toString()); 


try{ 

String modDN= "cn=Bill Merchant,ou=System Administration, 
o=Microwidgets Inc,c=US"; 

LDAPModificationSet ldm = new LDAPModificationSet () ; 
LDAPAttribute lda = new LDAPAttribute("1","Siberia") ; 
1dm.add(LDAPModification.REPLACE, lda) ; 
lda = new LDAPAttribute("street","Turnbury") ; 
1dm. add (LDAPModification.ADD,1da) ; 
ldc.modify(modDN,1dm) ; 


} 
) catch (LDAPException e){ 
a System.err.println(e.toString()); 


} 


try { 
ELECTRON C REVI EW sBSne TEC Omar EEN 
} 
catch (LDAPException e) { 
OF COM PUTER BOOKS! System.err.printin("Not connected") ; 
: } 
aR } 


public void deleteEntry(){ 
String deldn = "cn=Bobby Windsor, ou=Application Development, 
o=Microwidgets Inc, c=US"; 
LDAPConnection lde = new LDAPConnection() ; 
tryf 
lde.connect (ldapHost, ldapPort) ; 
} 


catch (LDAPException e) { 
System.err.println("Error connecting") ; 





Independent reviews of technical computer 


books. Written BY developers FOR developers 


} 
To order books in this tryt 
Ow magazine or, any book. ; lde.authenticate(authDN, authPw) ; 
: sm Please call 24 hrs/365 catch (LDAPException e) { 
The Virtual Bookstore days: (800) BOOKS-NOW ; System.err.println(e.toString()); 
(266-5766) or (702) 258-3338 ask for ext. 1410 or visit us on the web try{ 
at http://www.BooksNow.com/Dr.Dobbs. ita 


catch (LDAPException e) { 
System.err.println(e.toString()); 


try { 
1ldc.disconnect () ; 
System.out.println("Deletion successful") ; 


} 
catch (LDAPException e) { 
System.err.println("Not connected") ; 

} 

} 

public static void main(String[] args) { 
GatewayTests gt = new GatewayTests() ; 
gt.searchEntries() ; 
//gt.addEntry (); 
//gt.modifyEntry (); 
//gt.deleteEntry (); 
} 


DDJ 
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defect management methodology 
“closes the loop on bugs” so 
they're not lost, the right people 
are assigned and informed of 
bugs, and management gets the 
reports and graphs needed to 
allocate resources and plan 


schedules. 


GLOBE track: 











Let GLOBEtrack™ manage 
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and automate bug trackin 
: GLOBEtrack is easy to implement 


details so your team can ei ; 
and administer—use it on Windows, 


~ focus on what it does 
on UNIX or both. In less than an 


st—development. GLOBEtrack’s 
hour you can install, configure and 


immediately refocus engineering 


resources on development. 


GLOBE track 
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e A Web Interface for centralized 
& distributed teams 
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e Email, internet and intranet 
integration 
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aptures the bugs e SQL interface 
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Builds a searchable knowledge G xe, B Zz [ h erouninecarercueniie: 
base of bugs and fixes. ra 6 ‘ ee otter 


services group can do this for you. 





Automatically publishes bugs with 
Status to the web to keep specific users informed. GLOBEtrack even comes with its own database manager, 


Generates management reports and graphs. SO you don’t need to buy one. 


Closes the loop as bugs are resolved. 
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ot long ago I joined a team that had 
largely completed a new integrat- 
ed circuit tester that still lacked 
something generally viewed as es- 
sential in the automatic test equipment 
(ATE) world— a good pattern language. 
This situation presented a unique oppor- 
tunity to design and develop a language 
specification and compiler from scratch. 
Through the good graces of management, 
I had the luxury of devoting the time 
needed to create an engineering spec that 
clearly stated the functional requirements 
and, importantly, defined the exact syn- 
tax of the language in EBNF (short for “Ex- 
tended Backus-Naur Form,” a precise yet 
understandable way to describe a language. 
See Advanced Compiler Design and Im- 
plementation, by Steve Muchnick, Morgan 
Kaufmann Publishing, 1997). This took 
some time, but I would advise anyone try- 
ing to meet a schedule driven by market- 
ing that this is the only way to survive. 
The pattern compiler takes as input ASCII- 
text files written in the pattern language 
and produces as output binary files that 
conform to a spec for our machine. It 
compiles both algorithmic (see Listing 
One; available electronically, see “Resource 
Center,” page 5) and linear patterns (List- 
ing Two; also available electronically) for 
memory and logic devices, respectively. 
The language spec is 60-pages long, much 
of it EBNF. The compiler is comprised of 
a 5000-line Another Tool for Language 
Recognition (ANTLR) grammar and about 
10,000 lines of Java code (plus the Java 
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generated from the grammar). Its inter- 
esting attributes, which I will detail in 
this article, are the time to market ad- 
vantages imparted by the use of ANTLR 
(for more information about ANTLR, see 
http://www.antlr.org/), an excellent com- 
piler construction tool, and the use 
of Java. 


Why ANTLR? 

Many DDJ readers are familiar with the 
LEX and YACC compiler construction tools. 
I sometimes refer to ANTLR as “LEX and 
YACC for the third millennium.” Written 
entirely in Java, it generates either Java or 
C++, combines the lexical analyzer and 
parser specifications in one file, optional- 
ly generates abstract syntax trees (ASTs) 
and tree-walking classes, and allows very 
fine-grained control of the parse through 
predicates. In addition to being a great 
compiler construction tool, ANTLR is dis- 
tributed in source-code form, and it’s free. 
Moreover, no legal rights are reserved and 
the documentation clearly states that an 
“individual or company may do whatev- 
er they wish with source distributed with 
ANTLR or the code generated by ANTLR, 
including the incorporation of ANTLR, 
or its output, into commercial software.” 
That seems to eliminate the licensing and 
legal obstacles. And, if you require source 
because your native compiler doesn’t com- 
pile Java bytecode, it also removes a big 
technical obstacle. In this article, Pll show 
you how ANTLR works by leading you 
through some examples from my com- 
piler. Since there’s more to it than I can 
convey here, I recommend you download 
and read the online documentation from 
the http://www.antlr.org/ web site. If 


Compiler Construction 
with ANTLR and Java 


Tools for building tools 


you're interested in trying it out, there are 
some examples included in the source dis- 
tribution. ANTLR works equally well on 
all platforms that support a Java VM, and 
for the adventurous, there’s the C++ code 
generator. 

My experience with compiler construc- 
tion tools has taught me that the code they 
generate can be a lot slower— especially 
for large input files— than what you can 
achieve by handcrafting a compiler front 
end. However, a brand-new, complex 
and dynamic language like ours mandates 
the use of one. Fast time-to-market 
trumps performance, at least initially, and 
ANTLR helps achieve it by letting you ex- 
press the syntax of your language in an 
EBNF-like form (referred to as a “gram- 
mar”) and using it to generate lexical an- 
alyzer and parser classes. If you’ve de- 
fined your language in EBNF and have a 
willingness to master the ANTLR syntax, 
you can create and maintain a compiler 
very efficiently. You may also find some 
reuse opportunities. 


Elements of an ANTLR Grammar 

One of the first things you declare in an 
ANTLR grammar is the definition of a pars- 
er class. Thereafter, you're likely to define 
a start rule, possibly like Example 1. It cre- 
ates a method in the parser class, compila- 
tionUnit, which expects zero or more in- 
stances of “importDirective” or “language- 
Element.” These are rules defined elsewhere 
in the grammar. They express their own to- 
kens and semantic actions, either directly 
or by invoking other rules. Semantic actions 


‘in ANTLR are expressed as Java code en- 


closed in curly {} brackets and are triggered 
by subrules or whole rules. 
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(continued from page 84) 

You must create a class that defines a 
main() and start the parsing yourself. The 
class might be similar to Example 2. Some- 
times it’s useful to instantiate another pars- 
er object, and start it at a different rule. For 
instance, the pattern compiler by design 
recognizes two kinds of imported files, dis- 
tinguishing them on the basis of their file- 
name extensions. One requires the usual 


start rule, but the other uses a different start 


rule, which is optimized to recognize only 
two language elements. The rule that makes 
this choice, importDirective, is (minus ex- 
ceptions) in Example 3. It always recog- 
nizes the keyword import and a fileName, 
which handles path complexities and re- 
turns a String. It then instantiates lexer and 
parser objects that handle the imported file 
starting at the appropriate rule. 
CycleNames, a simple element of the 


ae language in Listing Three (avail- 


// This is the start rule for the parser. 
compilationUnit _ ss 


i importDirective y 1 


1 Clanguagetlonent se 





Example 1: An ANTLR start rule. 


// ... parse the file ... 


public static void Fs. ream 5, String fname 


throws Exception ( 
try { 


KPLParser eee 





// Create a scanner that z 








oe the input s 


ne w KPLHarver ese) 


parser. setCurrentFile (fname) ; 
// start parsing at the compilationUnit rule 


oo comp lationtins ); 


Example 2: Starting the parser. 


// import directive __ 
dmportDirective == 
// ipit-action—— w§® 
{File f=null; ‘String str=null; 
: i, rule 
_ “import” eteetiiciene 
// semantic actions 
_ ? - 
 f = new File(str) ; 





xer lexer = null; 





lexer = new EEllecer(ney #elnputstrean(2)): _ _ 
parser = new KPLParser(lexer);  _ 
_// this file’s either another pattern file... 
if (str. substring (str. length ()- =4). equals(“. pl) L 
parser. cee earn) - 


Jelsef 


__// ... or elee it'¢ a teat progran program ... 





parser.testProgram() ; 





Example 3: ANTLR rule for discriminating import directive. 
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able electronically), is a good example 
of how the pattern language ANTLR 
grammar is designed. Its rule (Example 
4) recognizes the keyword CYCLE 
_NAMES followed by tokens ASSIGN and 
LCURLY. These are defined in the lexer. 
This part of the rule is associated with a 
semantic action (Java inside curly brack- 
ets) that instantiates a CycleNames object 
and passes it by reference to another rule 
(actually a method in the parser class) 
which recognizes and stores its attributes. 
If the recognition phase of the rule com- 
pletes without exception, the semantic 
action at the end of the rule registers the 
CycleNames object with PBIBuilder. 


Compiler Design 
At this point a few words about the de- 
sign of the pattern compiler are in order. 
It's a simple compiler, comprised of three 
phases: lexical analysis/parsing, semantic 
analysis, and code generation. It general- 
ly adheres to the tenet that strict parti- 
tioning between phases for purposes of 
maintainability and portability is good (see 
Modern Compiler Implementation in Java, 
Basic Techniques, by Andrew W. Appel, 
Cambridge University Press, 1997). Occa- 
sionally though, I cross the line to avoid 
computationally expensive iterations, or 
to do incremental semantic analysis. 
Figure 1 shows the compiler classes and 
their relationships using Unified Modeling 
Language (UML). Each language element 
found in a pattern file is modeled as a class, 
and three classes control the three phases 
of the compiler. PB/Builder, modeled after 
the Mediator pattern (see Design Patterns: 
Elements of Reusable Object-Oriented Soft- 
ware, by Erich Gamma, et. al, Addison- 
Wesley, 1995), is used by each language 
element to register itself during the pars- 
ing phase. If no exceptions are thrown 
during the parse, a SemanticAnalyzer ob- 
ject visits each language-element object 
invoking the analyze() method (a class 
method). Code generation follows a sim- 
ilar course. If no exceptions are thrown dur- 
ing semantic analysis, a PBIWriter object vis- 
its each registered language-element object, 
invoking its generateCode() method. The 
visitor pattern implemented in Semantic- 
Analyzer and PBIWriter is facilitated by 
the fact that these classes extend PBI- 
Builder and share its registries. 


Why Java? 

I chose Java because ANTLR generates 
Java. Soon after I began using it, I discov- 
ered that Java is fun. It’s simpler than C++, 
safer than C, and there seems to be gen- 
eral agreement that it improves program- 
mer productivity. I tell people that I achieve 
a 25 percent productivity edge the minute 
I choose Java. No pointers. Objects and 
arrays are always passed by reference. 
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Primitive types are always passed by val- 
ue. Memory management is largely trans- 
parent to the programmer. Array bounds 
checking is automatic. The division of a 
class’s interface and its implementation 
is gone. Good-bye operator overloading 
and multiple inheritance. Java classes 
Gjava.lang, java.util, java.io, for instance) 
are powerful, simple to use, and not part 
of any standard library. T hey’ re part of 
the language by design, as are excep- 
tions, which are very useful for creating 
context-sensitive error messages. 

Other features I like include class vari- 
ables, class methods, and member classes. 
Java uses the static keyword to declare vari- 
ables and methods common to all instances 
of the containing class. When multiple in- 
stances of a class need to share some com- 
mon data or method, a situation not un- 
common, this model fits. Each instance still 
has its own methods and instance variables, 
but those declared static are shared. I find 
class variables and member classes useful 
for modeling complex data that has a shared 
component and a per-instance component; 
see Listing Four (available electronically). 
Class variable _ctrList is populated with dy- 
namically allocated instances of Dynamic- 
Source, a member class. Each instance of 
DynamicSource is internally associated 
with an instance of the containing class, Figure 1: Compiler class diagram. 
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SourceSelect, and they all are visible to the 
class method SourceSelect.generateCode( ). 


Native Compiler 
Java is normally compiled into a portable, 
bytecode format which is interpreted at 





Example 6: Method to transform a Java 





run time, and executed by a virtual ma- 
chine (VM). My marketing director viewed 
the virtual machine as a liability. Portabil- 
ity was not a priority, and an external 
software dependency (the VM) was not 
acceptable. I solved this problem by us- 





Se 
ee 





“portable” primitive type. 


Example 7: A disambiguating semantic predicate. 
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ing Symantec’s Visual Café for Java Ver- 
sion 3.0 (http://cafe.symantec.com/), an 
IDE that offers a Java compiler which gen- 
erates native Windows executables. In ad- 
dition to removing the VM dependency, 
it also largely resolves performance issues 
often associated with Java. A native exe- 
cutable that looks and runs like any oth- 
er is tough to argue with, even if you’re 
a hard-core Microsoft Visual C++ devo- 
tee. Of course, the fact that it runs as fast 
as other compiled code is no license for 
using poor programming practices. Mem- 
ory conservation, careful use of objects, 
and favoring primitive types still matter. 


Systems Programming in Java 

You may be wondering how Java is at 
performing the functions of an embed- 
ded system compiler— things like bina- 
ry I/O, bitwise logical, and bit-shifting 
operations. Example 5 shows how I use 
java.io.DataOutputStream to do binary out- 
put. Since, according to the JDK 1.1.5 on- 
line documentation for the java.io.DataOut- 
putStream class, DataOutPutStream “lets 
an application write primitive Java data 
types to an output stream in a portable 
way,” I’m able to do things like 


out.writelnt(LittleEndian.toInt(_addr)); 


Why LittleEndian.toInt()? It turns out 
Java’s “portable way” is Big endian and 
my target requires Little endian format. So 
I’ve created a class that transforms inte- 
gral types. One of its methods is shown 
in Example 6. As this code suggests, bit- 
wise logical operators in Java are basical- 
ly identical to C operators. However, since 
Java has no unsigned integral types, you 
have to take care to use the unsigned right 
shift operator, >>>, to fill in the high bits 
of the shifted value with zero. 


Controlling a Parse using Predicates 
Predicates are one of the enabling fea- 
tures of ANTLR. Example 7 illustrates 
how the pattern rule (Listing Five, avail- 
able electronically) distinguishes logic 
test patterns like _pum_ (Listing One) 
from memory test patterns like _ckb 
Diag_ (Listing Two). Their syntax up to 
a point is quite similar, then it becomes 
radically different. However, the PG 
_STATIC blocks that precede them es- 
tablish an attribute that can be tested 
with a semantic predicate to determine 
what’s next. If the condition (PBI- 
Builder.getPMode() == 1) is true, the 
parser knows to expect a logic pattern 
(lumVector). If not, a memory test pat- 
tern (pginstruction) must follow. 


Reusing the Compiler 


The compiler I’ve described, and the lan- 
guage it recognizes, are specifically designed 
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generator, modify the ANTLR grammar, 
‘and use the compiler to drive the simu- 
lation? Doing so: 
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rom 3D fly-throughs on the morning 

weather report to special effects in 

games and motion pictures, elements 

of 3D technology are cropping up 
everywhere around us. But as we start 
to interact with 3D virtual environments 
through games and simulations, we need 
new devices to drive this interactive ex- 
perience. While joysticks, trackballs, and 
computer mice are fine for 2D interfaces, 
motion-tracking devices— which report 
an object’s position and/or orientation 
in real time as it moves— are necessary 
to navigate 3D simulated worlds. 

In flight simulator systems, for in- 
stance, the pilot wears a fully immersive 
(not see-through) headset with a screen 
in front of each eye. A computer gen- 
erates a pair of images in front of each 
eye, creating a stereoscopic 3D scene. 
The 3D scene interactively changes as 
the pilot moves his head and controls 
(flies) the simulated aircraft. As the pi- 
lot turns his head, the motion tracker re- 
ports a change in position and orienta- 
tion to the computer. The 3D scene in 
front of his eyes then changes, just as it 
would in the cockpit of his aircraft. The 
realism of the 3D graphical scene is only 
part of a successful simulation. 

Correctly matching the pilot’s head 
motion to the 3D scene motion is an ab- 
solute requirement for a successful sim- 
ulation. If the scene moves when the pi- 
lot’s head is stationary, or if there is a 
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Controlling 
Motion-Tracking Devices 


Navigating simulated worlds 


Mike Harrington 


long lag between the pilot’s head mo- 
tion and the image motion, the simula- 
tion becomes ineffective. These factors, 
along with scene jitter, can cause dis- 
comfort (and even nausea) for users, de- 
feating the purpose of the simulated ex- 
perience. 

Tracking technologies used for these 
applications are based on mechanical, 
magnetic, optical, acoustic, and inertial 
sensors to measure 3D motion in real 
time. Motion trackers from InterSense 
(the company I work for; http://www 
.isense.com/) combine sensor technolo- 
gies through sensor fusion to produce 
low-latency, jitter-free 3D motion track- 
ing. Trackers can be configured to track 
only orientation. We refer to orientation 
trackers as “three degrees of freedom” 
(3DOF). A “six degrees of freedom” 
(6DOF) tracker reports both position and 
orientation. In most applications, multi- 
ple trackers are used to track several ob- 
jects. For example, a simulation system 
can track a user’s hand as well as his 
head so the user can interact with the 
simulated environment. Figure 1 shows 
a typical simulation system put togeth- 
er with off-the-shelf components. Note 
that both the tracker (mounted on the 
ceiling) and the user’s head-mounted 
display (HMD) are connected to a stan- 
dard PC. 

High-end flight simulation systems can 
consist of a $10,000 HMD, a $100,000 im- 
age generator, a $10,000 6DOF tracker, 
a motion platform cockpit, force feed- 
back controls, and sophisticated custom 
software. As the technology matures, the 


components of these high-end simula- 
tion systems are becoming cost effective. 
A number of companies, such as Sony, 
have HMDs that cost about $800 with 
similar performance to headsets that sold 
for $10,000 just a few years ago. Inter- 
Sense produces a 3DOF tracker, also for 
about $800, that gives high update rates 
with jitter-free outputs. Finally, graphics 
cards for PCs, as inexpensive as $200, 
come with OpenGL or DirectX hardware 
rendering functions and enough onboard 
video memory to produce a cost-effective 
simulation system. 


Tracker Performance Issues 

The same issues concerning tracker per- 
formance exist in both high-end and low- 
cost systems. How well the simulation 
works depends on how well the user’s 
motion is tracked and matched in the im- 
ages generated. The key areas of tracker 
performance are accuracy, jitter, latency, 
and latency jitter. 

Accuracy is how well the system re- 
ports the true position and orientation 
of the object being tracked. This is a 
function of the type of use and how well 
the system is set up. How accurate a 
tracker you need depends on a number 
of things, but the biggest factor is 
whether you plan on overlaying the vir- 
tual world on the real world. For ex- 
ample, you might have see-through 
headsets for augmented reality, or you 
might track a glove the user is wearing 
to interact with real objects. In these cas- 
es, a fraction of a degree or inch might 
make a huge difference in how well the 
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(continued from page 90) 

simulation works. In the case of fully im- 
mersive systems, the user does not have 
an external reference to check the accu- 
racy of the tracker oth- 
er than the horizon, 
which should be level 
when the head is lev- 
el. A tracker accurate 
to a degree in orienta- 
tion or an inch in po- 
sition will probably 
work well. 

Jitter is how much 
the reported position 
and orientation bounce 
around from the true 
or average value. A 
tracker that jitters will 
cause the generated 
scene to jump back 
and forth a couple of pixels every frame 
and cause much distress to the user. 

Latency is the time lag, measured in 
milliseconds, between the instant when 


How well the 
simulation works 
depends on how well 
the user’s motion is 
tracked and matched 





the user’s head position is sampled and 
the instant when the corresponding ren- 
dered scene begins to scan out onto the 
display. Many things contribute to the 
lag, including the 
time it takes the 
tracker to generate 
an output, the time 
it takes to transfer 
the output to the 
renderer, and the 
time to render the 
image. Latency usu- 
ally ranges from 16 
ms to 120 ms. 
Latency jitter is 
how much the laten- 
cy changes from 
frame to frame. In 
some systems it 
might jump between 
one frame of delay to two. This is not 
noticeable when the head is still, but 
when it is moving it will cause percepti- 
ble jumps in the images. 





Figure 1: Typical motion-tracking system. 
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Tracker Serial Interface Basics 

The interface to most trackers is through 
a standard RS-232 serial communications 
port. Trackers usually support rates from 
9600 to 115,200 bps. While the details of 
interfacing to each company’s tracker 
varies, the basic principles are the same. 

A tracker is set up to output data 
records in specified formats for the num- 
ber of sensors needed. Then, it outputs 
a data record for each configured sen- 
sor as fast as it can (continuous mode) 
or when a data record has been re- 
quested (polled mode). In either case, 
the tracker’s internal loop is running 
continuously and you output the data 
record after the sensors have been sam- 
pled and a new data record has been 
computed. Depending on how the track- 
er is set up, it can produce records at 
rates up to 150 Hz (for an IS-300) or 500 
Hz (for an IS-300 PRO or IS-600). It is 
important to make sure the record sizes, 
types, and rates are fast enough to keep 
up with the required record throughput. 

You can specify exactly what data you 
want in the data record for each station 
and its format. For reporting orientation, 
you have the option of choosing the Eu- 
ler angles of yaw, pitch, and roll in de- 
grees (3 floats); quaternions (4 floats); 
or direction cosines (9 floats). How the 
orientation is used in your code will de- 
termine if you want Eulers, quaternions, 
or direction cosines. The position can 
be reported as centimeters or inches for 
x, y, and z positions. All of the numbers 
can be reported in ASCII floats in nota- 
tion, binary as 32-bit IEEE floating-point 
numbers, or in a compacted 16-bit bi- 
nary format. 

Example 1 is a stream of data records 
from a tracker for a single ODOF station 
setup to report orientation in Euler an- 
gles and position in inches. Table 1 
shows the number of bytes in a data 
record for a number of different record 
formats. Table 2 shows the transmission 
time of records for different record for- 
mats and baud rates. Time to transmit 
your data can vary up to 30 times de- 
pending on how you have your serial 
port set up and the format you choose 
for data transmission. 

Listing One opens and configures the 
serial port under Windows 95. The only 
special note is that the reading of the port 
should be nonblocking. This is chosen be- 
cause during the real-time segment of the 
program you can not afford to wait for in- 
put characters. Instead, you parse as much 
data as is available when you service the 
serial port in the main loop. Using the sim- 
pler blocking writes for the serial port is 
allowed when continuous mode is used 
because there is no need to send data dur- 
ing the real time part of the program. 
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Listing Two is a straightforward track- 
er initialization routine. It is used to make 
sure the data you get from the tracker is 
what you expect upon the start of every 
session. This puts the tracker in a known 
state prior to data initialization. 





Serial Port Cautions 

oe _ _—— - | How well.you write your serial port in- 
Example 1: Typical stream of data records in ASCII mode sent from tracker to terface code affects the latency and la- 
computer. tency jitter in the system. One key con- 
cept, often overlooked, is use of the most 
recent record available. Because the sys- 
tem buffers the data as it comes in the se- 
rial port, you want to make sure that when 
you read a record from the tracker you 
check to see if there are others available, 
reading through all of them. This check 
should be performed in both polled or 
continuous mode, even if you flushed the 
buffers at the start. Problems occur if, at 
the start of your code, you introduce a 
two or more frame delay in your serial in- 
put buffers. This produces unnecessary 
latency in the system. 

You should do what checking you can 
on the data record. Since no checksum is 
sent with the data record, you should 
check for the O at the start, the station 
number, and that the correct number of 
bytes were received for this record. Oth- 
erwise, a corrupted record might cause a 
huge jump in the generated scene. 


Direct3D Main Loop 


Listing Three is the main loop from a 
simple DirectX Retained Mode full- 
Still not using XRT components for Motif? Poe ee 

plication for a number of reasons. First, 
it reduces the interactions with windows 
to get performance closer to real time. 





cate ite iets 


The XRT PDS (Professional Developer's Suite) from KL Group includes all the tools you need for 
powerful, flexible interface development. Tables and forms that obey your every whim. Charting and Second, it utilizes double buffering ef- 


graphing capabilities that will blow you away. Data entry and validation widgets that anticipate the vera oy Pet forming p #8€ tlipping to 
prevent tearing, thus allowing synchro- 


user's every move. And with the GUI taken care of, you can get on with building the rest of your nization of the display. Finally, because 


application a lot sooner. The alternative? Continue to reinvent the you-know-what. this is going to ultimately be used in a 
headset, the image should take up the 


entire screen. 
The main loop runs at the screen re- 
fresh rate set at 60 Hz if the rendering 
f of 8 engine is fast enough to render its im- 
Evaluate the world s leading Motif widgets today age in the given time. The loop starts by 
reading the serial port, then updating the 
user’s viewpoint to match the latest 
record received. Any animations in the 


Fully documented. Fully supported. Royalty-free. 


www.klgroup.com /xtteval : - scene are updated a step and then the 
Te scene is rendered to the back buffer. Fi- 
or call 1-888-361-9161 — nally, when the vertical sync is detect- 


ed, the flip is made between the back 
and front buffers. 


(— Getting a Handle 


on Latency and Latency Jitter 
RR CEO US KL Group Inc. Toll-Free: 1-888-361-9161 Fax: 416-594-1919 The latency and latency jitter can be cal- 


Software Develo t Productivi most major UNIX platforms, VMS, and Windows via Interix and NuTCRACKER as well as all major GUI builders. XRT/, XRT PDS, { 
frware Development Productivity Ani trian XRT/ gear, YRT/graph and XRT/table are trademarks of KL. Group In. Al other product names ae vademarks of culated for the Direct3D example. Assume 


reitered trademarks oftheir respective owners. DDOO4 | the tracker is running in continuous mode 
asynchronously with the rendering loop 
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running at 60 fps, and the tracker is in 
3DOF mode running at 500 Hz in binary 
output mode at 115,200 bps. The data 
transmission time is 1.4 ms and the track- 
er is running at a loop time of 2 ms. In 
this case, the smallest latency could be 2 
ms for the tracker to sample its sensors 
and produce an output record, plus 1.4 
ms to transmit the results, and 16.7 ms for 
the PC to read the serial port and render 
the image, for a total time of 20.1 ms. The 
worst case latency would be if the PC just 


missed an update from the tracker when. 


it read the serial port. This means its record 
would be 2 tracker cycles old=2 ms+2 
ms+1.4 ms=5.4 ms, giving a total latency 
of 16.7+5.4=22.1 ms. For this example, the 
latency ranged from 20.1 to 22.1 ms and 
the latency jitter is 2 ms. 

Ill now turn to a 6DOF station run- 
ning at 120 Hz. Even though at 120 Hz 
the loop time is 8.3 ms, you sample the 
inertial sensors and generate an updat- 
ed output starting about 2 ms into the 
loop. The rest of the loop time is spent 
using the ultrasonic system to correct 
for any errors in the system. So, if the 
tracker is running at 120 Hz, then the 
latency could be from as little as 
3.4+16.7=20.1 ms to 8.3 (one tracker cy- 
cle)+3.4+16.7=28.4 ms. For this exam- 
ple, the latency ranged from 20.1 to 28.4 
ms and the latency jitter is 8.3 ms. If 
your head is panning at 100 degrees per 
second, this latency jitter manifests it- 
self as 0.83 degrees of yaw jitter, which 
is very noticeable. 

To fix the latency jitter for the tracker 
running at 120 Hz, you can genlock the 
tracker to the vertical sync of the monitor 
(Figure 2). Now the render loop will get 
its data from the tracker cycle that start- 
ed 8.3 ms before the last vertical sync, giv- 
ing a latency of 16.7+8.3=25 ms, but a la- 
tency jitter of close to 0 ms. 

From these examples, it is clear that 
the two ways to eliminate latency jitter 
are to either use a tracker that can run 
at a very fast update rate or genlock the 
tracker to the monitor or image gener- 
ator. Once you have fixed the latency 
jitter you can use prediction to eliminate 
some, if not all, of the constant latency. 
Because InterSense’s motion tracker is 
based on measuring the user’s acceler- 
ations and angular rates, we can direct- 
ly predict the position and orientation 
of the tracked object from 0 to 50 ms 
ahead. This is better than simple dead 
reckoning prediction based on the last 
couple of positions and orientations, but 
it still will add some overshoot follow- 
ing abrupt motions, especially at values 
of greater than 30 ms. 

One other major factor in latency jitter 
is that it is important to fix the scene com- 
plexity such that the rendering can be 
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Table 2: Record transmission time. Single sensor record POS+Eulers 
in milliseconds. 


done in a fixed amount of time no mat- 
ter what direction the user is looking. If 
the rendering takes too long it will drop 


the frame rate. If frames are dropped while 
the head is moving, the image will look 
like it is jittering. 


Conclusion 

To make the most effective immersive sim- 
ulations with a given set of hardware, it 
is important to make sure that the inter- 
face to the motion tracker is working 
properly. And again, the key points for 
producing a successful simulation system 
are: writing an efficient serial port driver, 
using the appropriate data transfer for- 
mats, and elimination of the latency and 
latency jitter in a system. 


DDJ 





Listing One 


#include <stdio.h> 
#include <string.h> 
#include <windows.h> 
#include <process.h> 
#include <winbase.h> 
#include <time.h> 


BOOL rs232InitCommunications (HANDLE *portHandle, UINT32 comPort, 
UINT32 baudRate) ; 
BOOL rs232DeinitCommunications( HANDLE *portHandle) ; 


/ [RRRERKARARERERKAAKERK rg 232InitCommunications ***KKKRKRRRRRRRER KK 
BOOL rs232InitCommunications (HANDLE *portHandle, UINT32 comPort, 
UINT32 baudRate) 
{ 
COMMTIMEOUTS timeout; 
DCB dcb; 
const char openString[100]="9600,N,8,1"; 
rs232DeinitCommunications(portHandle); // close port if already open 
FillMemory(&dcb, sizeof(dcb), @); //now open the serial port 
*portHandle=CreateFile((comPort == 1 ? "COM1" : 
(comPort == 3 ? "COM3" : "COM4"))), 
GENERIC_READ | GENERIC_WRITE, 
@, ®, OPEN_EXISTING, FILE_FLAG_OVERLAPPED, 9) ; 
if (*portHandle == INVALID_HANDLE_VALUE) 
{ 
printf( "Failed to open communications port"); 
return FALSE; 
} 
// Set the timeouts for nonblocking reads and blocking writes 
if (!GetCommTimeouts(*portHandle, &timeout) ) 
{ 
printf( "Could not get timeout info"); 
return FALSE; 
} 
timeout.ReadIntervalTimeout = MAXDWORD; 
timeout.ReadTotalTimeoutMultiplier = @; 
timeout.ReadTotalTimeoutConstant = 9; 
timeout .WriteTotalTimeoutMultiplier = 10; 
timeout .WriteTotalTimeoutConstant = 180; 


if (!SetCommTimeouts(*portHandle, &timeout) ) 


{ 
printf( "Could not set timeout info"); 
return FALSE; 
} 
// now set up comm port with baud rate and other port parameters 
FillMemory(&dcb, sizeof(dcb), 9); 
dcb.DCBlength = sizeof (dcb) ; 


if (!GetCommState(*portHandle, &dcb)) 
{ 
printf( "Failed to get communications state"); 
return FALSE; 
} 
BuildCommDCB(openString, &dcb); 
dcb.DCBlength = sizeof (dcb) ; 
dcb.BaudRate = baudRate; 
dcb.fNull = FALSE; 
dcb.fBinary = TRUE; 
dcb.fAbortOnError = FALSE; 
dcb.fOutX = FALSE; 
deb.fInX = FALSE; 
deb. fOutxCtsFlow = FALSE; 
dcb.fOutxDsrFlow = FALSE; 
deb.fRtsControl = RTS_CONTROL_DISABLE; 


// use the passed baud rate 


if (!SetCommState(*portHandle, &dcb)) 
{ 
printf( "Failed to set communications state"); 
return FALSE; 
} 
return TRUE; 
} 


[ /RERRRRKAKKEREEKERERE 9232DeinitCommunications (eC CCC aRREK 
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(comPort == 2 ? "COM2" : 


BOOL rs232DeinitCommunications (HANDLE *portHandle) 


CloseHandle(*portHand1le) ; 
*portHandle = NULL; 


{ 
if(*portHandle != NULL) 
{ 
} 
return TRUE; 
} 
Listing Two 


itSendCommand(portHandle,"01,2,4,1\r\n");// setup output record format 


itSendCommand (portHandle,"f") ; 
itSendCommand (portHandle,"U") ; 
itSendCommand(portHandle,"11,1\r\n "); 
itSendCommand (portHandle,"12,@\r\n "); 
itSendCommand (portHandle,"13,@\r\n "); 
itSendCommand (portHandle,"14,@\r\n "); 
itSendCommand (portHandle,"C") ; 


Listing Three 


// station 1 for Eulers and Pos 

// binary mode 

// Set position to inches 

// Turn on station 1 

// Turn off station 2 

// Turn off station 3 

// Turn off station 4 

// Put the system in continuous mode 
// to start sending data 


void Render (void) 


{ 
RECT rect; 
DDBLTFX bl1tFx; 


updateTracker () ; 


// read in the most current tracker data record 
// use most current record to update users viewpoint 


updateOrientation (Orientation [@] [@] ,Orientation[@] [1], Orientation[Q] [2]); 
updatePosition (Position [@] [0] ,Position[@] [1] ,Position[@] [2]); 


rect.left 
rect.top 
rect.right 
rect.bottom 


0; // Clear the buffer we are about to render to 
0; 

64; 

480; 


ZeroMemory (&b1tFx, sizeof (DDBLTFX) ) ; 


biltFx.dwSize 


= sizeof (DDBLTFX) ; 


bltFx.dwFillColor = D3DRGB(1.0,1.0,1.0); // White background 
backBuffer->B1lt (NULL,NULL,NULL,DDBLT_COLORFILL | DDBLT_WAIT ,&bltFx) ; 


// Update the direct3D Retained Mode scene 
scene->Move (D3DVALUE(1.@)) ; 

view->Clear(); 

view->Render (scene) ; 

dev->Update() ; 


// Update primary surface by doing a flip when vertical sync comes along 
while(frontBuffer->Flip( NULL,@ ) == DDERR_WASSTILLDRAWING) ; 


} 


DDJ 
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Little Engines That Could 


Michael Swaine 


scientist becomes a perfect super- 

man after injecting himself with 

self-replicating microscopic ma- 

chines that continually repair his 
organs. A man rents a device that sets 
tiny machines loose in his brain, rewiring 
it so that he becomes, for a brief time, a 
different person. A cell-repair nanotech 
machine— a “nanny”’— fed with one 
person’s DNA and set to repairing an- 
other’s cells, begins turning the second 
person into the first. Infoviruses sys- 
tematically reprogram human genes, redi- 
recting evolution. Society is reshaped 
from top to bottom by nanotechnology. 
Experimental nanomachines escape from 
the lab and destroy the world. 

Mere science fiction, you say? Of 
course. Specifically, these are the plots 
of several science fiction stories appear- 
ing in Nanotech, a collection of cau- 
tionary tales in the subgenre of nano- 
technology-based science fiction, edited 
by Jack Dann and Gardner Dozios (Ace 
Books, 1998; ISBN 0-441-00585-3). Sci- 
ence fiction writers were profoundly in- 
fluenced by the publication of Eric 
Drexler’s Engines of Creation (Anchor 
Books, 1987; ISBN 0-38-519-973-2). In 
that book and in the more technical 
Nanosystems: Molecular Machinery, Man- 
ufacturing, and Computation (John Wi- 
ley & Sons, 1992; ISBN 0-47-157-518-6), 
Drexler defined the field of nanotech- 
nology, mapped out its challenges, and 
articulated its most promising avenues 
of research. A number of science fiction 
writers staked out nanotech as their cho- 
sen science to fictionalize, and a sub- 
genre was born. 


Michael is editor-at-large for DD]. He can 
be contacted at mswaine@swaine.com. 
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Others besides science fiction writers 
were influenced by Engines of Creation. 
Researchers around the world have been 
exploring the possibilities for nanotech- 
nology since the book’s publication. Last 
fall, Drexler’s Foresight Institute brought 
the leading researchers together to explore 
the state of the art in nanotechnology to- 
day. In this month’s column I'll explore 
the conclusions of the Foresight confer- 
ence (and a couple of other little issues, 
such as a groundbreaking new program- 
ming language for little people). So far, 
none of the predictions of nanotech sci- 
ence fiction have come true. So far. 


EDSAC Lives 

But first, this: A visit to http://www 
.dcs.warwick.ac.uk/~edsac/ will reward 
anyone interested in the history of com- 
puting. It's where you can view screen 
shots, read the description, and down- 
load a copy of the EDSAC simulator. 
EDSAC was the first stored-program 
computer to operate a regular comput- 
ing service. It was designed and built at 
Cambridge University, England, and it 
went online 50 years ago. 

Closeted in a top-floor room of the uni- 
versity’s Mathematical Laboratory, EDSAC 
filled dozens of racks and was flanked by 
three round CRTs that displayed the con- 
tents of memory in a grid of glowing spots, 
and a table holding the paper-tape read- 
er and teleprinter. Unlike ENIAC, there 
was no bank of switches to set to enter 
calculations; EDSAC was a true stored- 
program computer, and got its input from 
paper tape. The simulator, which has all 
the controls and displays of the original 
EDSAC, simulates the CRT grid to show 
the contents of main memory, and shows 
the accumulator and other registers, 





elapsed time, and teleprinter output. User 
controls include Clear, Start, Reset, Stop, 
Single E.P., and single-digit entry. PC and 
Mac versions are available. 


20/20 Foresight 

Now, back to the nanofuture. Engineer- 
ing is a clumsy discipline, because we 
are big and clumsy beings. It’s ultimate- 
ly all about moving atoms, but our fin- 
gers are too large to place each individ- 
ual atom where we want it, and so are 
the tools that we use in place of fingers. 
What we need, in order to manipulate 
individual atoms—or _ at least 
molecules— and thus realize the full pos- 
sibilities of engineering, are new tools. 
Very tiny, very precise tools. 

We should be able to build these tools, 
but there is a Catch-22: To build such pre- 
cision tools, we need the very tools we 
are trying to build. Or something very like 
them. Is there a way to bootstrap the pro- 
cess, and somehow get past the Catch-22 
and on to doing perfect engineering, with 
all the wonderful benefits that this would 
bring? There may be. 

In 1957, physicist Richard Feynman 
wrote: 


Principles of physics, as far as I can see, do 
not speak against the possibility of ma- 
neuvering things atom by atom. It is not an 
attempt to violate any laws; it is something, 
in principle, that can be done; but in prac- 
tice, it has not been done because we are 
too big. 


To some, Feynman’s speculation on 
atom-by-atom manufacturing was a call 
to arms. The field that has emerged as a 
result of their response to Feynman’s 
challenge is called “nanotechnology.” To- 
day, to quote NASA Ames’s Stephen 


99 





Walch, one of the leading nanotechnol- 

ogists: 
A number of people are currently working 
on the possibility of manufacturing minia- 
ture machinery one atom at a time as Feyn- 
man had visualized it. The concept is re- 
ferred to as molecular manufacturing and 
would have tremendous application in 
many areas... 


Last November, researchers from all over 
the world gathered in Silicon Valley to 
share the latest developments in nano- 
technology and the subdiscipline of molec- 
ular manufacturing, and to examine how 
close the field is to realizing any of those 
applications. 

In the long term, nanotechnology’s pro- 
ponents expect it “to bring atomic preci- 
sion to fields ranging from medicine to 
manufacturing, curing most diseases and 
eliminating chemical pollution.” Add to 
that the wonders of superstrong, superlight 


materials and microscopic processors, and 
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you can see why nanotechnology speaks 
so compellingly to science fiction writers. 


Little Gems of Research 

In the shorter term, progress in nano- 
technology is most obviously recognized 
in the Foresight Institute’s Feynman Prizes, 
of which it awarded two at last fall’s con- 
ference, one for theoretical and one for 
experimental work. 

The theoretical Feynman Prize went to 
Xerox PARC’s Ralph Merkle and the afore- 
mentioned Stephen Walch for developing 
computational models of molecular tools. 

Merkle, nanotechnology pioneer Eric 
Drexler, and others have articulated one 
particular model for nanomanufacturing, 
in which atoms are moved into place via 
reactive tools on the end of a probe. 
Merkle and Walch did the math for this 
model, to determine which reaction se- 
quences work and which don’t for the 
specific problem of placing a single car- 
bon atom or two carbon atoms on the sur- 


ull force é that a good al 
ader of my life was going 
in in finding errors in my Own programs.” — 
Wilkes had Ces the debug- 
ging cycle. 





— MS. 


face of a diamond. Diamond, having nice 
properties for manufacturing and a stable 
crystal structure, is a target building ma- 
terial for much nanoresearch. Since 
nanomachines would be able to manu- 
facture diamond in any quantity, cost 
would not be an issue. Merkle and Walch 
cleared a trail a significant distance in the 
direction of such nanomanufacturing. 
Merkle’s work can be seen at http://nano 
xerox.com/nano/. 

M. Reza Ghadiri of Scripps Research In- 
stitute got the experimental Feynman Prize 
for “his groundbreaking work in con- 
structing molecular structures through the 
use of self organization, the same forces 
used to assemble the molecular machine 
systems found in nature.” In Ghadiri’s lab, 
researchers have designed and built a 
number of self-assembling nanotubes. 
Ghadiri’s work is described at his web site 
(http://www.scripps.edu/pub/ghadiri/), 
and you can watch an animation of the 
replication process at http://www.scripps 
.edu/pub/ghadiri/html/selfrepli.html. 
These tiny tubes may one day prove use- 
ful as nanoscale wires or drug delivery 
systems. 


A Biopowered Nanomotor 

In other work reported at the conference, 
a team of nanoresearchers at Cornell is 
hard at work trying to integrate organic 
and inorganic machines into hybrid sys- 
tems. By “organic machines” they mean 
biological molecules like F1-ATPase, a pro- 
tein that can reasonably be described as 
a motor. Fl-ATPase gets into a spin over 
the synthesis/hydrolysis of ATP, generat- 
ing a force of over 100 pN and twirling 
around at something short of its calculat- 
ed no-load rotational velocity of 17 rps. 
This organic machine has a diameter of 
less than 12 nm, smaller than any inor- 
ganic machine that anyone has yet been 
able to build. 

But they’re getting close. The Cornell 
researchers, whose work is described at 
http://www.foresight.org/, are working 
with nanodevices that are on a scale 
compatible with F1-ATPase. If they can 
combine manufactured, inorganic devices 
with these organic motors, there may 
come a day when, as they predict, “F1- 
ATPase motors will pump fluids, and 
open and close valves in microfluidic de- 
vices, and provide mechanical drives for 
a new class of nanomechanical devices.” 
F1-ATPase occurs naturally in practical- 
ly every living organism, and is auto- 
matically synthesized by the machinery 
of life. If it can be integrated with inor- 
ganic nanomachinery, it could be the key 
to creating a transparent interface be- 
tween the organic and inorganic worlds. 
The researchers have come a long way. 
They have already figured out how to 
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manipulate the protein’s coding se- 
quence, produce large quantities of the 
protein, and “place specific ‘handles’ on 
the enzyme for the precise attachment 
to nanofabricated devices and substrates.” 
Now they’re looking into issues like heat 
dissipation, but basically, all the tools are 
now in place to build biological-motor- 
powered mechanical devices within a liv- 
ing cell. 

If all the details work out, “these efforts 
will provide a significant step toward the 
seamless integration of nanoscale tech- 
nologies into [a] living system, and are cen- 
tral to the creation of organic/inorganic 
intelligent systems,” they say. 


Nanomanipulators 

The nanoresearchers who gave presenta- 
tions at the conference routinely fiddle 
with exotic microscopic structures with 
names such as fullerenes, buckyballs, 
bucky horns, and nanotubes in their quest 
for control of the very small. But it’s more 
accurate to say they try to fiddle with these 
little doodads. In fact, manipulation of 
such nanoscale devices is more or less the 
near-term goal of nanotechnology. 

One session at the conference demon- 
strated achievement of that goal. Wash- 
ington University student Min Feng Yu 
showed a movie (you can see it at 
http://www .foresight.org/) of a real break- 
through— the direct manipulation, inde- 
pendently in all three dimensions plus ro- 
tation, of a 5 nm-diameter nanotube. 

It was done by connecting the tube to 
two atomic force microscope tips. The 
technique can be used to assemble nano- 
devices, but more subtly, it is now possi- 
ble to manipulate the tubes so as to study 
the effects of strain and force on them. 
This is important because knowing the 
structural properties of the materials is cru- 
cial to being able to build with them. 


Nansistors 

Dozens of other researchers described 
their small advances at the conference. 
Cees Dekker of Delft University of Tech- 
nology in The Netherlands described a 
field-effect nanotube transistor, a Tube- 
FET. Mark Akeson of the University of 
California at Santa Cruz described how he 
has developed a device for reading nu- 
cleic acid strands; the most obvious ap- 
plication being sequencing of individual 
DNA strands at very high rates. 

Fotis Nifiatis at CUNY won the Distin- 
guished Student Award for research in 
molecular self assembly. 

Stepping back from the excitement the 
conference generated among its atten- 
dees, it is clear that there is still a long 
way to go before the full possibilities, or 
any possibilities, of the application of 
nanotechnology will be realized. Con- 
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sidering what some of those possibilities 
are— and I don’t think that the science 
fiction writers are overreacting — maybe 
we should be glad of that. But Drexler’s 
original outline of the field acknowl- 
edged that the road would be a long 
one, and so far the work seems to be 
right on track. 


Science fiction 
writers were 
profoundly 

influenced by the 
publication of Eric 
Drexler’s Engines of 
Creation 





ToonTalk 

ToonTalk is a programming language and 
environment for children. Currently it only 
runs under Windows. You can download 
a trial version of it from http://www 
.toontalk.com/. 

Ken Kahn has been developing 
ToonTalk for years, and released it just re- 
cently. It draws on a number of comput- 
er games and programming models, in- 
cluding Rocky’s Boots, Zelda, and other 
adventure games, the concurrent constraint 
programming language Janus, Carl He- 
witt’s Actor programming language, Logo 
and Smalltalk, and Jaron Lanier’s Grasp 
language. It is worth a look, particularly 
for the remarkably successful way it makes 
abstract programming concepts visible. 

In ToonTalk, you, the programmer, are 
represented in the model by an animated 
character. You program by moving about 
ToonTalk’s world as you would in a com- 
puter game, picking up objects and ma- 
nipulating and combining them. 

Often what you pick up are boxes. Box- 
es are the data cells of ToonTalk, and can 
contain any kind of data. Boxes click to- 
gether like Lego blocks to construct data 
structures akin to arrays or tuples. There 
are primitive data types such as numbers, 
and instances of these types can be 
dropped into boxes. Tapping the contents 
of a box with a wand makes a copy of it, 
and dropping one thing on another com- 





bines them in a meaningful way (adding 
numbers, for example). 

In addition to the wand, there are a 
number of colorful tools for operating 
on the things you construct. A vacuum 
cleaner turns out to be a good way to 
make cut-and-paste visible, but it has 
another use that is rather subtle. Drop- 
ping the number 1 in a box and then 
turning the vacuum cleaner on it sucks 
out the value of the number, leaving a 
box with an unspecified number in it. 
This technique of sucking out the value 
is a clever way of making visible the gen- 
eral idea of a variable, a parameter place- 
holder, or a template. 

The tutorials use this trick well. Con- 
crete problems are posed, involving fixed 
values. Then concrete elements are re- 
placed with abstract placeholders, gener- 
alizing the problem. 

The functionality of programs is em- 
bodied in robots and cities, robots repre- 
senting methods and cities representing 
programs or computations. A cartoon 
thought balloon above a robot’s head 
shows what’s on his mind. To give him 
ideas about particular data structures and 
what to do with them, you drop boxes 
into his thought balloon and do things to 
their contents, abstracting the concrete ac- 
tions to construct a general method. The 
chief decision tool is a scale. 

The tutorials and demos supplied with 
the full release version show how to 
combine data structures and methods 
into objects by pasting boxes and robots 
to the backs of pictures. Full objects are 
represented by houses. The demos also 
show how to spawn new processes (the 
metaphor is a truck) and they demon- 
strate techniques in logic programming, 
string manipulation, and recursive data 
structure construction. Robots can be 
combined in teams, and you can save 
your programs in a notebook. ToonTalk 
is a true concurrent programming lan- 
guage supporting the dynamic creation 
and termination of communicating asyn- 
chronous processes. The communication 
metaphor involves pigeons and nests. Pi- 
geons carry messages between objects, 
and an object will only welcome a pi- 
geon carrying a box that matches the 
(template) box in the object’s nest. The 
most remarkable thing about ToonTalk 
is how far Kahn has gone in animating 
the construction of programs and the ac- 
tion of the constructed programs. This 
is by no means easy, one reason being 
that if you can see the program running, 
it's obviously running too slowly. 
ToonTalk’s solution? Robots, like em- 
ployees in the Bizarro world, work re- 
ally fast when nobody’s watching them. 


DDJ 
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C PROGRAMMING 





Templates and 


Exception Handling 


Al Stevens 


his month puts Quincy 99 and D-Flat 

2000 on hold while I continue my dis- 

cussion of the migration from C++ to 

Standard C++. But first, the book of 
the month. 

C++ programmers should have a copy 
of the Standard C++ specification. When 
you question how a code idiom should 
work, the document is the final author- 
ity because it is supposed to tell com- 
piler implementors what to do. That isn’t 
to say that the document is necessarily 
an accurate reference of the C++ lan- 
guage that your compiler implemented; 
they’re all still playing catch-up. How- 
ever, if you code to the document and 
your compiler accepts your code, you 
can be assured that your code is rea- 
sonably correct. If your code looks cor- 
rect and the compiler rejects it or com- 
piles something other than what the 
document says, chances are the compil- 
er hasn’t achieved full compliance yet. 
Few if any C++ books on the market to- 
day fully and accurately cover Standard 
C++. Most use code idioms that can be 
compiled rather than ones that reflect 
the standard. Until all parties —— book au- 
thors and compiler implementors— get 
in step, the standard document is the 
only trustworthy guide to writing stan- 
data: Gre, 

You can purchase a copy of the stan- 
dard in PDF format, which you can view 
by using the ubiquitous and free Adobe 
Acrobat reader (http://www.adobe.com/). 
You can download the standard document 
from http://webstore.ansi.org/ansidoc- 
store/default.asp/. You’ll need to provide 


Al is a DDJ contributing editor. He can be 
contacted at astevens@ddj.com. 
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a credit card number. The document costs 
$18.00 and is well worth the money. It’s 
almost as good as an HTML version, which 
is not available. The main deficiency is 
that the document fails to provide inter- 
nal links when passages refer to other pas- 
sages, apparently reflecting a deficiency 
in the Acrobat PDF document model. 


More About 

Migrating to Standard C++ 

Last September and October I discussed 
several C++ language features and be- 
haviors that the C++ standardization effort 
added to the language. Included were dis- 
cussions of the bool and wchar_t types, 
the scope of a variable declared in the 
first controlling expression of a for state- 
ment, similar new behavior in if, while, 
and switch expressions, new behavior for 
enum, overloaded new// and delete//, 
placement new and delete, new style head- 
ers, and the namespace feature. That dis- 
cussion continues this month with some 
observations about two language fea- 
tures that the ANSI/ISO committee did 
not invent but that were significantly 
changed as a result of the committee’s 
deliberations. 

The Annotated C++ Reference Manu- 
al (the “ARM”) by Margaret Ellis and 
Bjarne Stroustrup (Addison-Wesley, 1990) 
was the first formal definition of tem- 
plates and exception handling, two C++ 
language features that the authors de- 
scribed as “experimental.” Coincident 
with that publication, some commercial 
compilers implemented the new features 
to comply as closely as they could with 
the ARM’s definition, modifying those 
implementations as the committee made 
changes and converged on an approved 





standard and as the features became bet- 
ter understood. Consequently, in the 
eight years since the ARM was published, 
programmers have gained much experi- 
ence in the use of templates and ex- 
ception handling, but a few of the com- 
mittee’s additions have raised some 
debate among the C++ programming 
community, particularly with respect to 
committee additions to exception han- 
dling. Some programmers question the 
effectiveness of the changes and others 
defend them. I do not intend to add to 
the debate, but I will address some of 
the issues, explain how they work, and 
consider their implications from the per- 
spective of a programmer who uses 
them. First, however, I will discuss my 
own experience with the partial spe- 
cialization of templates. 


Template Partial Specialization 
Template specialization allows you to pro- 
vide an implementation of a template for 
a particular type. The first class template 
in Listing One parameterizes types called 
T and A. The second class template is a 
specialized version that the compiler uses 
whenever the program instantiates an ob- 
ject of type vector for parameterized types 
of int and char*. 

The ARM does not address template 
specialization, although compilers have 
implemented the feature for several years, 
sO we can regard it as a reasonably well- 
understood feature that was introduced 
by the committee — that is, not a feature 
of traditional ARM C++. 

Don’t be confused by my use of the 
identifier vector in Listing One. It is not 
the same as sid::vector because it is not 
in the std namespace. My reason for using 
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this particular name becomes apparent 
soon. Incidentally, template specializa- 
tion is the only place I have found where 
the standard permits a programmer to 
add declarations and definitions to the 
std namespace. Your compiler might al- 
low it, but the practice is considered a 
bad one and is forbidden usage by the 
language of the standard specification. 

Partial specialization lets you provide 
a specialized version of a template 
wherein the specialization specializes 
some, but not all, of the arguments. List- 
ing Two is a partially specialized version 
of the vector class template. You can sim- 
ilarly specialize a function template. 

In The C++ Programming Language, 
Third Edition, (Addison-Wesley, 1997), 
Bjarne Stroustrup uses inheritance to 
demonstrate partial specialization by us- 
ing an idiom similar to Listing Three. His 
example demonstrates how to partially 
specialize a class for void pointer argu- 
ments and then inherit from that class 
for specializations of parameterized 
types. It is the only example of partial 
specialization in the book; I do not think 
it is a particularly representative one be- 
cause by using inheritance, the exam- 
ple goes beyond the idiom of partial 
specialization to demonstrate partial spe- 
cialization. Observe that in Listings Two 
and Three, the partially specialized class 
templates inherit nothing from the class 
templates that they specialize. You must 
fully reimplement all the class template’s 
behavior. 

Suppose, however, that you want to 
specialize the behavior of a member 
function of a somewhat complex class 
template. You’d rather not reimplement 
the entire class template. You can fully 
specialize a class template member func- 
tion as Listing Four shows. Class tem- 
plate member function specializations 
are supposed to be treated the same as 
function template specializations, but 
the compiler implementation that I use 
(egcs 1.1) does not permit partial spe- 
cialization of class template member 
functions as Listing Five tries to do. I 
cannot find a specific reference to or ex- 
ample of this kind of specialization of 
member functions in the standard doc- 
ument. However, Dr. Stroustrup thinks 
that full and partial specialization of class 
template member functions is permitted. 
I guess I'll have to wait for the compil- 
ers to comply. 


PTL Revisited 

So why do I want to partially specialize 
class template member functions? One 
year ago in this column I published the 
Persistent Template Library (PTL), which 
uses inheritance to specialize the behav- 
ior of the Standard C++ container classes 
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so that they are persistent; the instantia- 
tion of a persistent container object in- 
vokes its constructor, which fills the con- 
tainer with the persistent values from the 
object store disk file. If users modify the 
container in memory, the destructor 
rewrites the container contents to the disk 
file. I wanted to implement persistence 


Why do I want 
to partially 
specialize class 
template member 
functions? 





with an allocator that the user could spec- 
ify to override the default allocator argu- 
ment for the various container classes. This 
approach was not possible given the state 
of the PC compilers this time last year 
(“this time,” of course, included publish- 
ing lead time). Standard C++ does not pro- 
vide a mechanism with which the alloca- 
tor can tell the container that it is allocating 
and filling memory with data values. Al- 
locators do not know anything about the 
containers that use them. Containers al- 
locate the memory they need assuming 
that they are empty when constructed 
and that the using program will fill them 
with data (except, of course, when they 
are constructed from other containers). I 
said last year: 


I thought I might make the persistent allo- 
cator concept work by partially specializ- 
ing each container to overload its con- 
structors to communicate with the allocator. 
Until PC compilers implement partial spe- 
cialization, however, I cannot experiment 
with this approach. 


Discussions in comp.std.ct++ remind- 
ed me of this approach, and one partic- 
ipant, Nathan Myers, a frequent contrib- 
utor to DDJ, even suggested that I use it 
now that partial specialization is widely 
implemented. My first attempt to do so 
involved the partial specialization of the 
std::vector constructor for instantiations 
that override the default allocator with a 


custom persistent allocator to see if I 
could make the allocator fill the con- 
tainer with values during construction. 
As it turned out, I could not take that 
approach given the state of compilers to- 
day (at least in this shop) because, as I 
pointed out earlier, apparently one can- 
not partially specialize a member func- 
tion. I would have to partially specialize 
all of std::vector and the other contain- 
er classes, instead, and reimplement all 
their behavior, which I do not want to 
do. Someone has already done that 
work. I prefer to use existing efforts 
rather than duplicate them. 


Exception Specifications 

There has been some controversy about 
the new C++ exception specification fea- 
ture. Some programmers feel that the fea- 
ture should not have been included in the 
language, and, given that it has, should 
not be used. 

An exception specification adds code 
to a function header to specify what ex- 
ceptions may be thrown after the function 
is called and before the function returns. 
This code tells the programmer who calls 
a function, which exceptions the calling 
function should be prepared to catch, and 
alerts as to the consequences of not catch- 
ing the potential exceptions. Listing Six is 
a function header with an exception spec- 
ification. 

The function in Listing Six is permitted 
to throw only exceptions of type MyEx- 
ception and types publicly and unam- 
biguously derived from MyException. To 
specify more than one exception, use a 
comma-separated list. The compiler is not 
required to issue a diagnostic if the pro- 
gram violates this permission; after all, the 
compiler cannot know about all the ex- 
ceptions that might be thrown by other 
functions that are directly or indirectly 
called by the current function. 

If a function has no exception specifi- 
cation, the function is permitted to throw 
any exception. If a function has an emp- 
ty exception specification as Listing Sev- 
en shows, the function may not throw any 
exceptions. 

These choices were intentional. A more 
intuitive interface would disable excep- 
tions when no specification is given and 
use something like throw (...) to specify 
that any exception may be thrown. These 
proposals are not workable because of 
the effect on existing code that predates 
the exception specification feature. In The 
C++ Programming Language, Third Edi- 
tion, Stroustrup says: 


...that would require exception specifica- 
tions for essentially every function, would 
be a significant cause for recompilation, 
and would inhibit cooperation with soft- 
ware written in other languages. 
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If the program violates the exception 
specification, the system calls the spe- 
cial unexpected() function, which you 
may override to throw an acceptable ex- 
ception. If unexpected() throws an un- 
acceptable exception (or, I expect, tries 
to return— the standard does not spec- 
ify what happens if uwnexpected() tries 
to return; it only says that it must not), 
the system calls terminate(), unless the 
violated exception specification includes 
std::bad_exception, whereupon the sys- 
tem converts whatever unexpected() 
throws to std::bad_exception. Got that? 
It ain’t intuitive. 

So, what was the controversy all 
about? Some programmers believe that 
exception specifications are good only 
for documentation when you get them 
right and can constitute a debugging haz- 
ard when you get them wrong and un- 
expected terminations result. When a 
function has an exception specification, 
an unexpected thrown exception is not 
caught by the function’s catch(...) han- 
dler if it has one. Presumably, a pro- 
grammer knows what exceptions are 
likely to be thrown and why. If you do 


there’s not much you can do in a 
catch(...) handler other than intercept 
the catch and use your debugger’s call 
stack to see where it came from. If you 
let the system call terminate(), it’s too late 
to see where it happened, unless you 
override terminate(). It might be any- 
where in those thousands of lines of code. 

Questions also arise about how to prop- 
erly use exception specifications in func- 
tion templates and class template mem- 
ber functions when the very “genericity” 


of the template concept removes all 


knowledge of the types being parameter- 
ized from the author of the functions. Fur- 
thermore, because exception specification 
compliance is typically checked at run time 
rather than at compile time, there is no 
static check that a particular template in- 
stantiation is likely to cause a call to fer- 
minate() following an unaccepted throw. 
It would seem that templates and excep- 
tion specifications are not comfortable with 
one another, at least in their current im- 
plementations. 


Whence D-Flat 2000 
Well, it isn’t 2000 yet. Nonetheless, some 


2000, my C++ framework based on free 
software development tools. When will 
I finish it? When will I publish it? The 
answer is that I need to complete the 
Quincy 99 compiler suite first. The work 
on the IDE is mostly finished (http:// 
www .midifitz.com/alstevens/quincy99) 
with only the integration of the pro- 
grammer’s editor (http://www.midifitz 
.com/alstevens/editor) remaining. I now 
eagerly await the availability of a Stan- 
dard C++ library for the egcs 1.1 com- 
piler, which Quincy 99 uses. I await this 
development because I want the frame- 
work to be based on current technolo- 
gy. Such a library is under development, 
and if you want to participate, you can 
do so by visiting http://sourceware 
.cygnus.com/libstdc++/. ’m writing this 
column toward the end of December, 
1998, and the experimental library still 
lacks several necessary components. Per- 
haps by the time you read these words, 
the library will be close to completion. 





not know of all the potential exceptions, readers have written to ask about D-Flat DDJ 
Listing One Listing Four 
// —- fully parameterized vector template <class T, class A> 
template <class T, class A> class vector { 
class vector { public: 
public: vector(T t, Aa) { } 
vector(T t, Aa) { } void f() ( } 
35 33 
// —- fully specialized vector // -- specialized f() 
template <> template <> void vector<int,int>::f() 
class vector<int, const char*> { { 
public: } 
vector(int t, const char* cp) { } int main() 
y3 { 
int main() vector<int, int>  fce(1,2); // uses regular f() 
£c,£t)3 
vector<int, int> fc(1,2); // uses parameterized vector vector<int, char*> fi(1,"1"); // uses specialized f() 
vector<int, char*> fi(1,"1”); // uses specialized vector £i.£(); 
} 
e e e e L) 
Listing Two Listing Five 
// —- partially specialized vector // -- partially specialized f() 


template <class T> 


template <class T> void vector<T, int>::f() 
{ 


class vector<T, char> { 
public: } 
vector(T t, char) { } 
int main () r ; Sj 
isting SIX 
vector<int, char> fp(1,’a’);  // uses partially specialized vector s g 
void £() throw(MyException) 
{ 
IP esis 
L) e } 
Listing Three 
template<class T, class A> . 
class vector { Listing Seven 
public: 
vector(T, A) {}. void £() throw() 
; { 
template<class T> class vector<T, void*> { IT aes 


public: 
vector(T, void*) {} 


template<class T, class A> class vector<T, A*> ; 
public: 

vector(T t, A*¥ a) : vector<T, void*>(t, a) { } 
int main() 
{ 

int. 2 s.:1233 

char* cp = “filename”; 

vector<int, char*> vip(234, cp); 
} 
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private vector<T, void*> { 
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JAVA Q&A 





How Do | Implement Microsoft's 


delegate in Pure Java? 


Andrew Wilson 


he Microsoft delegate keyword brings 

a shudder to many pure Java devel- 

opers. This keyword locks an appli- 

cation to the Microsoft VM, eliminat- 
ing the possibility of running the 
application on a nonWindows platform. 
However, delegate provides you with a 
new event-handling scheme that can sim- 
plify complex GUI applications. 

Another problem is that delegate works 
with the Windows Foundation Class 
(WFC), but does not work with the ex- 
isting AWT or the new Java Foundation 
Classes (JFC) event models. Both the AWT 
and JFC event models could benefit from 
the delegate scheme. 

Bringing delegates to pure Java code is 
currently not possible. However, creating 
something that behaves similar to a dele- 
gate is not too difficult. Consequently, I'll 
present classes that mimic the delegate 
keyword, allowing you to build a com- 
plex user interface with simpler event- 
handling code. The complete source code 
and related files for this delegate-like im- 
plementation are available electronically 
(see “Resource Center,” page 5). 


Event Handling and AWT 

Each Java AWT and JFC GUI object sends 
various events. Events often represent user 
actions, like pressing a key or clicking a 
mouse button. Events also represent state 
changes in the application, such as the win- 
dow closing or the window needing to be 
repainted. Event objects often represent 
specific areas of the application. For ex- 
ample, there are WindowEvent objects that 
represent events relating to the state of the 
current window. Handling these events is 
beyond the scope of this column; howev- 


Andy, a developer for NuMega Technologies, 
can be contacted at andyw@numegad.com. 
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er, I will examine a few of the more com- 
mon event-handling schemes. 

The first (and simplest) way to handle 
events in a GUI application is to override 
one (or a few) of the core event-handling 
methods —processEvent, processCompo- 
nentkvent, processKeyEvent, process- 
Mousekvent, or processMouseMotionkvent. 
These methods dispatch events to an ob- 
ject of type java.util.EventListener. How- 
ever, you can override any of these meth- 
ods to handle a given event. 

Overriding an event-dispatching method 
raises a couple of important issues. First, 
these dispatchers only dispatch events di- 
rectly related to the GUI object. For exam- 
ple, if a user clicks on a button within a 
frame, only the button’s processEvent 
method is called. Also, the overridden event- 
dispatching method must call the base 
class’s event- dispatching method; otherwise, 
other event handlers may not execute. 

The second way to handle an event is 
by registering a java.util.EventListener ob- 
ject with a GUI object. Such an object (an 
event listener) gives you a lot of flexibili- 
ty. This event-handling scheme allows for 
three different ways of implementing 
event-handling code. 


EventListener-based Event Handlers 
Event- dispatching methods call EventLis- 
tener object methods. Consequently, 
EventListener objects should implement 
some sort of event-handling code for a 
given event type. Event-handling code can 
do anything from disabling a button or 
menu option, to saving the current docu- 
ment and exiting the application. 

The java.awt.event package contains 
most of the standard Event and EventLis- 
tener classes. There are several different 
event classes, and for each Event class 
there is an EventListener class. Each Event 





class represents a variety of different pieces 
of information about the GUI object. For 
example, a WindowEvent object may in- 
dicate if a window is being resized or 
closed. The corresponding WindowLis- 
tener class has methods that handle the 
various WindowEvent states. Therefore, 
there are methods that specifically handle 
window resizing and closing events. 

Using EventListener classes is straight- 
forward; you create a new class and im- 
plement all the methods of the EventLis- 
tener interface for the event you want to 
receive. For example, if an application 
wants to receive WindowEvent objects, 
the application must have a class that im- 
plements all the methods of the Win- 
dowListener interface. The only issue is 
that many of these EventListener classes 
have several methods that you must im- 
plement. Many of these methods are un- 
necessary for most applications, so you 
end up writing a lot of code that never 
gets used. 

Realizing that implementing unused 
methods in interfaces is annoying, Sun im- 
plemented most of the EventListener class- 
es with event-adapter classes. These adapter 
classes have the function definitions of the 
underlying interface stubbed out. You can 
simply inherit from the adapter class and 
override the methods for the events you 
are interested in handling. 

There are three ways to handle events 
using these EventListener derived classes. 
The first is that you implement the 
EventListener in the applet or application 
GUI class. Obviously, you can implement 
as many EventListener interfaces as you 
wish. Doing this is usually helpful because 
the event handlers have direct access to 
all class fields. The biggest drawback is 
that you may have to stub out many un- 
used event-handler functions. 


107 





The second method is to override an 
event-adapter class, or implement a new 
EventListener class as a class separate from 
the main GUI class. This method is more 
modular and relatively easy to debug. It 
also has the virtue of not forcing you to 
implement every event method, if you are 
using the event-adapter class. The down- 
side is that the new event-handler class 
may not have access to all the GUI class’s 
member fields. 

The third method is to implement an 
event adapter as an anonymous or nest- 
ed class. This method is a more tricky, and 
sometimes more difficult to debug. How- 
ever, both anonymous and nested class- 
es have access to the GUI class’s member 
fields. 

The notion of an anonymous class is a 
little strange. The idea is that I can define 
a class inline during construction. Exam- 
ple 1 illustrates this notion. When the com- 
piler executes on the Java source file, the 
compiler generates a new class file rep- 
resenting the anonymous class. The result 
is something like “Foo$1.class” for the 
anonymous class. Consequently, each time 
you build your application, the anony- 
mous class name may change. Beyond 
this, there is almost no difference between 
an anonymous class and a nested class; 
both can access all the fields and meth- 
ods of the enclosing class. 

The downside to anonymous classes is 
that debuggers may have difficulty with 
breakpoints and debug information. It has 
also been argued that the construct is more 
difficult to read and is not portable from 
one application to the next. 

After creating an event-handling class, 
you must bind the event handler to a GUI 
object. The GUI object will then send 
events corresponding to the event handler 
via the event-dispatching methods. 

Overriding event dispatchers or imple- 
menting EventListener classes brings up 
a few issues. First, overriding an event- 
dispatcher method requires you to add 
some code to check for a particular event. 
However, this event checking occurs con- 






Example 1: An anonymous class. 


108 


stantly, and consequently introduces a sig- 
nificant amount of overhead. Second, im- 
plementing separate EventLlistener classes 
causes the event-handling code to be dis- 
jointed from the main GUI class’s code, 
thus some symmetry between creation and 
event handling is lost. Third, implement- 
ing EventListener interfaces in the main 
GUI class often forces you to write a lot 
of unused code to stub out event-handler 
definitions. Finally, using anonymous or 
nested classes, though they work fine, can 


Event-dispatching 
methods call 
EventListener object 
methods 





make the code somewhat less readable, 
and the classes are no longer portable be- 
tween applications. 

These gripes are just a few irritations 
that you can deal with rather easily. How- 
ever, all of these methods require you to 
write a lot of boilerplate code that is used 
in nearly every GUI application. Eliminat- 
ing the boilerplate code would certainly 
simplify the development process and re- 
move some of the tedium. 

This leads us to the delegate keyword. 


The delegate Keyword 

A delegate can simply be described as a 
proxy. You register a method with the del- 
egate, and then register the delegate with 
a WFC GUI object. When the GUI object 


receives an event, the GUI object forwards 
the event to the delegate, which forwards 
the event to the event-handling method 
you wrote. You may define any method 
to receive an event, however, the method 
must have a specific signature. 

A method signature is made up of the 
order and type of parameters, along with 
the return type. Event-handler methods 
in the delegate model use the same ba- 
sic signature. The event-handler method 
has no return type (void), and takes two 
parameters. The first is of type Object 
and represents the original sender of the 
event. The second parameter is the event 
object itself. 

Listing One shows a delegate in use. 
The initForm() method builds the user 
interface in a WFC application. This 
method is often automatically generated 
using Visual J++ 6.0. The interesting line 
is the call to sortButton.addOnClick(new 
EventHandler(this.sortClick)). 

The sortButton.addOnClick() method 
takes a parameter of type EventHandler, 
a delegate class. All delegates require a 
java.lang.reflect.Method object as a pa- 
rameter. The Method object represents 
the user-defined event-handling method. 
For this EventHandler object, the event- 
handling function is this.sortClick. 

The effect of this line of code is the 
binding of a method (sortClick) to a del- 
egate, then a delegate to a GUI object (sort- 
Button). Consequently, every time users 
click on the button, the sortButton object 
sends an event to the delegate, the dele- 
gate forwards the event to the sortClick 
method. 

This implementation allows the delegate 
class to be a separate entity from the main 
GUI class. However, the event-handling 
code remains in the main GUI class. The 
advantage is that you only need to imple- 
ment a method to handle a specific event 
type. Moreover, you don’t have to write any 
boilerplate code for event handling. 

delegates are actually more complex than 
I’ve just described. A delegate is actually a 
special type of class, but its declaration is 
completely different from any other class 
declaration in Java. In fact, a delegate’s dec- 
laration looks more like a function. Listing 
Two is a custom delegate necessary to han- 
dle some asynchronous sorting. There is no 
constructor in this declaration. All delegate 
constructors take one parameter, a Method 
object. Instead, the delegate declaration de- 
fines the signature of the event-handling 
method. According to this listing, the user- 
defined event-handler method must have 
two parameters, the first of type Object, rep- 
resenting the sender of the event, and a sec- 
ond of type WFCSortEvent, representing the 
event itself. 

Probably the most important thing to 
note about Microsoft delegates is the con- 
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which is automatically generated. 

Listing Three shows the WFC class that 
binds the delegate class to the object. List- 
ing Four shows how the class actually sends 
an event. Finally, Listing Five shows the ap- 
plication binding a local event-handing 
method to the delegate, and subsequently 
to the object that will send the event. 

This seems like a lot of code to allow 
for something as simple as a notification 
message. However, much of this code was 


automatically generated by the Visual J++ The complexity of today’s software development demands a make utility 


environment, so it took only about a sec- ns that won't waste your time. OpusMake is fast (up to 4x's faster than 
ond for the code to appear. Intersolv Config. Builder), powerful (our underlying technology relieves 
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tionality. Consider building a delegate to ae quickly and reliably, only OpusMake makes it! Because you've got better 
handle WindowEvent objects. You simply things to think about. 


need to implement a WindowListener class. 
This class must store a set of Method ob- 
jects. Each Method object represents a user- 
defined event-handler method. The class 
needs to override the WindowListener meth- 
ods, and invoke the appropriate Method 
object. This results in the same sort of event- 
forwarding functionality provided by Mi- 
crosoft delegates. 

The WindowDelegate and its base class 
(available electronically) binds event- 
handling methods to specific event types. 
Once this binding is done, you just bind 
the user-defined event-handler to the GUI 
object. Listing Six performs the binding in 
the main GUI class, and the subsequent 
event-handler method. 

The resulting WindowDelegate class is 
a reusable object, allowing you to use this 
delegate-like class in every application, 
without having to modify the delegate class 
itself. However, this pure Java delegate 
class will work on all AWT and JFC ap- 
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The delegate class I present here brings all 
the benefits of both EventListener and del- 
egate classes. The pure Java delegate class 
lets you register a method in any class as 
an event handler for any class that sup- 
ports the JDK 1.1 event model. The event- 
handling code remains in the main GUI 
class, but does not break the EventListen- 
er model. Finally, all the boilerplate code 
is written once for all applications, elimi- 
nating the tedium of writing classes or im- 
plementing methods that are never used. 
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Listing One 


Button sortButton = new Button(); 
private void initForm() 


{ 


sortButton.setDock(ControlDock. BOTTOM) ; 
sortButton.setLocation(new Point(@, 277)); 
sortButton.setSize(new Point(30@, 23)); 
sortButton.setTabIndex(@) ; 

sortButton.setText ("Sort") ; 

sortButton.addOnClick(new EventHandler(this.sortClick) ); 
/*Download complete sample for full code */ 


private void sortClick(Object source, Event e) 


m_pDlg = new ProgressDialog(); 

m_pDlg.show(); 

m_pDlg.progressBar.setMaximum( m_items.length ); 
m_items = m_app.sortItems( m_items ); 


showItems(); 


Listing Two 


public delegate 
void WFCSortEventDelegate ( Object sender, WFCSortEvent e ); 


Listing Three 


package WFCExtensions; 


import com.ms.wfc.core.*; 
import com.ms.wfc.ui.*; 

import com.ms.lang.Delegate; 
public class WFCApp extends App 


if 


WFCSortEventDelegate m_SortCompletionEvent ; 
WFCSortEventDelegate m_SortProgressEvent ; 
public WFCApp ( int items ) 
{ 
super ( items ); 
ae 
public void addOnSortCompletionEvent (WFCSortEventDelegate value) 
{ 
m_SortCompletionEvent = (WFCSortEventDelegate) Delegate. 
combine(m_SortCompletionEvent, value) ; 
} 
public void addOnSortProgressEvent (WFCSortEventDelegate value) 
{ 
m_SortProgressEvent = (WFCSortEventDelegate) Delegate. 
combine (m_SortProgressEvent, value) ; 
} 
protected void onSortCompletionEvent (WFCSortEvent event) 
{ 
if (m_SortCompletionEvent != null) m_SortCompletionEvent. 
invoke(this, event); 
} 
protected void onSortProgressEvent(WFCSortEvent event) 
{ 
if (m_SortProgressEvent != null) m_SortProgressEvent. 
invoke(this, event) ; 
} 
public void removeOnSortCompletionEvent (WFCSortEventDelegate value) 
{ 
m_SortCompletionEvent = (WFCSortEventDelegate) Delegate. 
remove (m_SortCompletionEvent, value) ; 
} 
public void removeOnSortProgressEvent (WFCSortEventDelegate value) 
{ 
m_SortProgressEvent = (WFCSortEventDelegate) Delegate. 
remove (m_SortProgressEvent, value) ; 


} 

protected void sortCompleteEvent( ) 

{ 
WFCSortEvent e = new WFCSortEvent() ; 
onSortCompletionEvent( e ); 

} 


protected void sortProgressEvent( int position, int total ) 

{ 
WFCSortEvent e = new WFCSortEvent ( position, total ); 
onSortProgressEvent( e ); 

} 

public static class ClassInfo extends com.ms.wfc.core.ClassInfo 


{ 


public static final EventInfo sortCompletionEvent = new EventInfo( 


WFCApp.class, "sortCompletionEvent", EventHandler.class) ; 


public static final EventInfo sortProgressEvent = new EventInfo( 


WFCApp.class, "“sortProgressEvent", EventHandler.class) ; 
public void getEvents(IEvents events) 


{ 
super. getEvents (events) ; 
events.add(sortProgressEvent) ; 
events.add(sortCompletionEvent) ; 
} 
public void getProperties(IProperties props) 
{ 
super. getProperties (props) ; 
J 


Listing Four 


import java.util.*; 
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public abstract class App 


{ 


protected int[] m_items; 
public App(int items) 


{ 


} 


m_items = new int[ items ]; 
fillItems( m_items ); 


protected void fillItems( int[] items ) 


{ 


} 


Random rnd = new Random(); 


for ( int i = @; i < items.length; it+ ) 


{ 
int tmp; 
do 
{ 
tmp = rnd.nextInt(); 
} while ( tmp < @ ); 
m_items[i] = tmp; 
} 


public int[] sortItems( int[] items ) 


{ 


} 


int[] sortedList = new int[ items.length ]; 


System.arraycopy( m_items, @, 


sortedList, 9, m_items.length ); 


for ( int i = 0; i < sortedList.length; i++ ) 


dList.length; jt+ ) 


sortedList[j] ) 


ortedList [i] ; 


tmp; 


ems.length ); 


{ 
for( int j = i; j < sorte 
{ 
if ( sortedList[i] > 
{ 
int tmp = sortedList[j]; 
sortedList[j] = s 
sortedList[i] = 
} 
} 
sortProgressEvent( i, m_it 
} 
sortCompleteEvent () ; 


return sortedList; 


public int[] getItems( ) 


i 


return m_items; 


protected abstract void sortCompleteEvent( ); 
protected abstract void sortProgressEvent( int position, int total ); 


Listing Five 


public class Example1l extends Form 


WFCApp m_app; 
public Example1() 


‘ 


super (); 
m_app = new WFCApp ( 2580 ); 
m_items = m_app.getItems(); 


m_sortedItems = m_app.sortItems( m_items ); 


// bind custom delegate class 


es to WFCApp class 


m_app.addOnSortCompletionEvent ( 
new WFCSortEventDelegate( this.sortCompletionEvent ) ); 


m_app.addOnSortProgressEvent ( 


new WFCSortEventDelegate( this.sortProgressEvent ) ); 


initForm(); 


Listing Six 


public class Example2 extends Frame 


public void initForm ( ) 


/** Download complete source for full example */ 


this.addWindowListener ( 
new WindowDelegate( this, 
"windowClosing", 
WindowDelegate.CLOSING ) 


)3 


public void windowClosing ( WindowEvent e ) 


{ 
{ 
} 
{ 
} 
} 


System.exit (1); 


DDJ 
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Implementing Fast DCTs 


Tim Kientzle 


he Discrete Cosine Transform (DCT) is 

a crucial part of modern image and 

sound compression. It is used in JPEG, 

MPEG video, MPEG audio, and Digital 
VCR, to name just a few. Mathematically, 
the DCT provides a way to break a com- 
plex signal down into separate components, 
and does so in a way that’s nearly optimal 
for compression. 

However, the computational overhead 
of the DCT is an obstacle to efficient im- 
plementation of these compression algo- 
rithms. In a typical DCT-based encoder/ 
decoder, DCT calculations alone can easi- 
ly take up 50 percent of the CPU time for 
the entire program. 

In this article, I’ll discuss several fast al- 
gorithms for computing the 8-point DCT 
and IDCT. Since these algorithms are typ- 
ically expressed using a diagram notation, 
Pll present both the diagrams and a 
somewhat mechanical technique for 
translating these diagrams into efficient 
C code. Using this technique, building 
efficient DCT and IDCT implementations 
is straightforward. 


Why DCT? 

Lossy compression— whether for video, 
audio, or still graphics—rests on a sim- 
ple idea: You want to identify impercep- 
tible features and remove them without 
changing features that are noticeable. To 
do this, you need a good understanding 
of human perception and a mathematical 
tool that can separate features. 

From a purely mathematical standpoint, 
the Karhunen-Loeve Transform (KLT) is an 
ideal tool for separating a data stream into 
separate features. The KLT works by first 
analyzing the data to identify certain statis- 
tical properties, then using those properties 
to construct an optimal decomposition. Un- 
fortunately, this analysis is extremely time 
consuming— you have to analyze the data, 
construct a transform tailored to that data, 
then compute the final transform. 


Tim is senior technical editor for DD]. He 
can be reached at kientzle@ddj.com. 
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The DCT closely matches the KLT for 
common types of data, and is simpler to 
compute. The DCT converts a single block 
of data into a collection of DCT coeffi- 
cients. Intuitively, you can think of these 
coefficients as representing different fre- 
quency components. The first coefficient 
(the DC coefficient) is simply the average 
of the entire block. Later coefficients (the 
AC coefficients) represent successively 
higher frequencies. (For graphics com- 
pression, “higher frequency” roughly cor- 
responds to “finer detail.”) 


Typical DCT Use 

A typical compression algorithm starts by 
breaking the data into small blocks. A DCT 
is applied to each block. Each coefficient is 
then multiplied by a fixed weight; higher- 
frequency coefficients typically use small- 
er weights. The result is that the higher- 
frequency values become small, zeros will 
usually predominate. Finally, standard com- 
pression techniques such as Huffman, arith- 
metic coding, or simple run-length coding 
are used to pack the coefficients into a 
small number of bits. Often, this process is 
iterative; if the final encoded data is too 
large, the weighting is adjusted and the co- 
efficients are compressed again. Usually, 
the compressed output indicates the 
weighting used. 

Decompression works in reverse. First, 
the bits are decoded to yield a series of 
weighted coefficients. Then, each coeffi- 
cient is divided by the corresponding 
weight and an Inverse DCT is used to re- 
cover the final values. 

The DCT and Inverse DCT are not lossy 
except for minor errors in calculation. The 
lossy part of this process is the weighting 
and inverse weighting that effectively 
rounds less-important coefficients to one 
of a few numbers. Of course, designing 
a good weighting requires a detailed 
knowledge of human perception. 


1D and 2D DCTs 
DCT-based graphics compression usually 
employs an 8x8 DCT. For this reason, there 





has been extensive study of this particular 
DCT. Figure 1 shows the equations for the 
DCT. Figure 1(a) is the one-dimensional 
(1D), 8-element DCT, while Figure 1(b) is 
the corresponding equation for the two- 
dimensional 8x8 Forward DCT. 

Figure 1(c) is the same as Figure 1(b), 
but factored to illustrate an important 
property. The square brackets in Figure 
1(c) enclose a 1D, 8-element DCT com- 
puted over each row of the input sam- 
ples. Once this is computed, the outer 
sum is another 1D, 8-element DCT. In 
simpler language, you can compute a 2D 
DCT by first computing a 1D DCT over 
each row, then computing a 1D DCT 
over each column. This separation is the 
first crucial step to developing a fast DCT 
algorithm. Even in the most naive im- 
plementation, a separated 2D DCT can 
easily be 10 times faster than the non- 
separated version. 

Figure 2 shows the corresponding 
equations for the IDCT. The IDCT can be 
separated in the same fashion as the For- 
ward DCT. 


DCT Flow Diagrams 

The starting point, then, for a fast 2D DCT 
is a fast 1D DCT. Figure 3 is the flow di- 
agram for a typical fast algorithm. 

The diagram notation used in Figure 
3 is fairly standard; some slight variation 
of this notation is used in almost every 
paper discussing the DCT. Figure 4 
shows the basic building blocks of this 
notation. 

Figure 3 is typical in several respects. 
After the first stage, the algorithm splits 
into even and odd halves; the even half 
(in the purple area) is just a four-point 
DCT. Similarly, this four-point DCT splits 
into two halves, one of which is a two- 
point DCT in the red area. All of the ad- 
ditions in Figure 3 appear in symmetric 
add/subtract pairs. In fact, the entire first 
stage is simply four such pairs in a very 
typical cross-over pattern; note that the 
four-point DCT diagram starts with a sim- 
ilar pattern. 
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Translating Flow Diagrams into Code 
If you step through the diagram, it’s re- 
markably routine to convert these dia- 
grams into efficient code. I'll demonstrate 
by converting the four-point DCT diagram 
in Figure 5 into C code. The inputs in Fig- 
ure 5(a) are labeled x0 through x3. I'll 
also need one additional variable which 
I call x4. The red lines in Figure 5(b) in- 
dicate a sum; x4 is currently unused, so I 
put the sum into x4. I now have to com- 
pute the difference in Figure 5(c); I place 





that result in x0, and x3 is now available 
to be used in Figure 5(d). The remaining 
add/subtract pairs are calculated follow- 
ing the same pattern. (An animated GIF 
version of Figure 5 is available electroni- 
cally; see “Resource Center,” page 5). 
The rotation is a bit trickier. First, as in 
Figure 6, you can use a temporary vari- 
able to reduce the calculation to only three 
multiplications. (& is a constant here.) Once 
you’ve calculated the temporary variable, 


Figure 1: Forward DCT equations. s is the input samples, C is the resulting 
coefficients. a(x) is 1/sqrt(2) if x is O, 1 otherwise. Typically, N= 8; (a) one- 
dimensional; (b) two-dimensional, (c) two-dimensional, rewritten to show 


separation. 





Figure 2: Inverse DCT equations. C is the DCT coefficients, s is the output 
samples. a(x) is 1/sqrt(2) if x is O, 1 otherwise; (a) one-dimensional; (b) two- 
dimensional; (c) two-dimensional, rewritten to show separation. 





Figure 3: Fast 8-element, 1D DCT (from Loeffler, Ligtenberg, and Moschytz). 
Note that the purple box encloses a 4-point DCT; the red box encloses a 2- 
point DCT. 
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In this code, by the time you get to cal- 
culate the rotation, x3 is available and can 
be used for the temporary variable. By let- 
ting x0 be C and B, and using x1 for A 
and D, you end up with the efficient code 
in the last part of Figure 6. 

I’ve used 10-bit fixed point for the con- 
stants in the rotation. This means that at 
the end of the algorithm, I have to shift 
the outputs of the rotation to the right by 
10 bits. Before I do this, I add 512, which 
is 1/2 in 10-bit fixed-point arithmetic. This 
properly rounds the result, and signifi- 
cantly improves the accuracy. (The 512 is 
actually added to x3 earlier so that both 
x0 and x1 will be correctly biased.) The 
only remaining step is to assign the final 
values to the correct output locations. 

Implementing the full algorithm in Fig- 
ure 3 is similar. The only tricky part is that 
the outputs of the bottom two rotations must 
later be multiplied by another constant. This 
requires care to prevent overflow; if you use 
10-bit fixed-point values for both multi- 
plications and 32-bit arithmetic, then the in- 
puts to these rotations can’t exceed 12 bits. 
Fortunately, to get 11-bit accuracy, the 
square root of 2 is 2896/2048, which is ex- 
actly equal to 181/128. Thus, you can get 
11-bit accuracy with 7-bit fixed point, re- 
ducing overflow problems. Listing One is 
the resulting code, while Listing Two ex- 
tends this to the full 2D 8x8 DCT. 

The inverse DCT can be directly im- 
plemented from the same diagram. You 
follow the same rules, only working from 
left to right instead of right to left. 


Performance 
Listings One and Two are fast DCT imple- 
mentations. To illustrate, I implemented the 
basic formulas given at the beginning of this 





Figure 4: Flow diagram notation. 
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Figure 5: Flow diagram for 4-element 
DCT; (@ inputs; (b) x4=x0 +x3; (C) 
xO-=x3; (d) X3 =x1+x2; (e) complete 
diagram. 
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total of 80 internal multiplications for a 
full 8x8 DCT. 

Finally, since DCT implementations are 
fairly compact and speed critical, hand- 
coded assembly is often a good idea. In 
particular, newer processor extensions, in- 
cluding Intel’s MMX, directly support sim- 
ple parallelism, allowing you to compute 
multiple 1D DCTs at a time. This works 
extremely well for separable 2D DCT al- 
gorithms, such as the ones I’ve discussed 
in this article. 


Accuracy 

Although optimizing a program for speed 
often requires sacrificing accuracy, fast 
DCT algorithms can actually be more ac- 
curate than slower algorithms. Remember 
that each multiplication involves some loss 
of accuracy due to roundoff. Algorithms 
with fewer multiplications are therefore 
not only faster, but also more accurate. 
The only place that practical DCT imple- 
mentations sacrifice accuracy is by using 
fixed-point rather than floating-point arith- 
metic. With careful attention to rounding, 
however, even fixed-point implementa- 
tions can be extremely accurate. 

The listings that are available electroni- 
cally use several different measurements to 
assess the accuracy of a DCT implementa- 
tion. The basic approach is to generate ran- 
dom test data, compute the DCT in two dif- 
ferent ways, and compare the results. The 
reference version is a direct implementation 
of the formulas using double-precision float- 
ing point. Among the measurements that 
are of interest are: 


e How many outputs are in error, and by 
how much? 

e Is the output correct for certain special 
inputs? 


For a fixed-point implementation using 
32-bit arithmetic with 8-bit inputs, no out- 
put should be in error by more than one, 
and a typical block should have no more 
than one error for each eight elements. If 
all the inputs are the same, the AC coef- 
ficients should all be precisely zero. 

Another way to measure the error is to 
compute the “mean square error’— simply 
take the difference between your test out- 
put and your reference output, square the 
results, and compute the average for each 
block of data and for several thousand 
random tests. If you have no errors larg- 
er than one, the mean square error is sim- 
ply the percentage of incorrect outputs. 
The test programs (available electronical- 
ly) measure and display several of these 
error measurements. 


Weaknesses 
DCT-based image compression is based 
on two principles. The first is that the 
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and Nakajima DCT algorithm (from JPEG: Still Image 


Data Compression Standard). Boxes represent multiplication. a1= 0.707, 
a= 0.541, a3=0.707, ag=1.307, as= 0.383. 





DCT— because it approximates the 
Karhunen-Loeve Transform— is a nearly 
optimal mathematical decomposition. The 
other is that the human eye is less sensi- 
tive to errors in fine details. Since those 
fine details are represented by high-fre- 
quency components, you can safely dis- 
card some or all of that information. 

The problem is that the eye is quite sen- 
sitive to edges, which are also represented 
by high-frequency components. DCT-based 
image compression does not do well on 
images that have a lot of hard edges, such 
as line art or text. Also, because each block 
of data is compressed independently, DCT- 
based compression is subject to “edge ar- 
tifacts,” in which the reconstructed blocks 
no longer match at the edges. 
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Listing One 


static void 
detidTest(int *dctBlock) { 


int 
int 


static const 
static const 


c1=1004 /*cos(pi/16)<<10*/, s1=200 /*sin(pi/16)<<10%*/; 

c3=851 /*cos(3pi/16)<<10*/, s3=569 /*sin(3pi/16)<<10%*/; 

static const int r2c6=554 /*sqrt(2)*cos(6pi/16)<<10*/, r2s6=1337; 

static const int r2=181; /* sqrt(2)<<7 ¥*/ 

int x@=dctBlock[@], x1=dcetBlock[1], x2=dctBlock[2], x3=dcetBlock [3], 
x4=dctBlock[4], x5=dctBlock[5], x6=dctBlock[6], x7=dctBlock[7]; 

int x8; 


/* Stage 1 */ 
x8=x/7t+x@; x@-=x7; 
x6=x2tx5; x2-=x5; 


x7=xitx6; x1-=x6; 
x5=x3+x4; x3-=x4; 


/* Stage 2 */ 

x4=x8+x5; x8-=x5; x5=x7+x6; x7-=x6; 

x6=c1*(x1+x2); x2=(-si-c1)*x2+x6; x1=(s1-c1) *x1+x6; 
x6=c3*(x@+x3); x3=(-s3-c3)*x3+x6; x@=(s3-c3) *xOt+x6; 


/* Stage 3 */ 

x6=x4t+x5; x4-=x5; 

x5=r2c6*(x7+x8); x7=(-r2s6-r2c6) *x7+x5; x8=(r2s6-r2c6) *x8+x5; 
x5=x@0+x2 ;x@-=x2; x2=x3t+x1; x3-=x1; 


/* Stage 4, round, and output */ 

dctBlock[@]=x6; dctBlock[4]=x4; 

detBlock[2]=(x8+512)>>10; dctBlock[6] = (x7+512)>>10; 
dctBlock[7]=(x2-x5+512)>>10; dctBlock[1]=(x2+x5+512)>>10; 
detBlock [3] =(x3*r2+65536)>>17; dctBlock[5]=(xO*r2+65536)>>17; 


Listing Two 


static void 
det2dTest (int (*dctBlock) [8]) { 


c1=1004 /*cos(pi/16)<<10*/, s1=200 /*sin(pi/16)<<10%/; 
c3=851 /*cos(3pi/16)<<10*/, s3=569 /*sin(3pi/16) <<10%*/; 
r2c6=554 /*sqrt (2) *cos (6pi/16) <<10*/, r2s6=1337; 
r2=181; /* sqrt(2)<<7 */ 


int 
int 
int 
int 


const 
const 


static 
static 
static const 
static const 
int row,col; 


for (row=0; row<8;rowtt) { 
int x@=dctBlock[row] [@], x1l=dctBlock[row] [1], x2=dctBlock[row] [2], 
x3=dctBlock[row] [3], x4=dctBlock[row] [4], x5=dctBlock[row] [5], 
x6=dctBlock[row] [6], x7=dctBlock[row] [7], x8; 
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/* Stage 
x8=x/7+tx@; 


/* Stage 
x4=x8tx5; 
x6=c1* (x1 


x6=c3* (xO+x3) ; 


/* Stage 
x6=x4tx5; 
x1=r2c6* ( 


/* Stage 
dctBlock [ 
dctBlock[ 


DDJ 
1 */ 
x@-=x7; x/7=xitx6; x1-=x6; x6=x2+x5; x2-=x5; x5=x3+x4; x3-=x4; 
2 */ 
x8-=x5; x5=x/7+x6; x/-=x6; 
+x2); x2=(-s1-cl) *x2+x6; x1=(s1-cl) *x1t+x6; 


x3=(-s3-c3) *x3+x6; x@=(s3-c3) *xO+x6; 


3 */ 

x4-=x5; x5=x@+x2;x@-=x2; x2=x3t+x1; x3-=x1; 
x7+x8); x7=(-r2s6-r2c6) *x7+x1; x8=(r2s6-r2c6) *x8tx1; 
4 and output */ 


row] [@]=x6; dctBlock[row] [4]=x4; 
row] [2]=x8>>10; dctBlock[row] [6] = x7>>1@; 


detBlock [row] [7] =(x2-x5)>>1@; detBlock [row] [1] =(x2+x5)>>10; 
detBlock[row] [3]=(x3*r2)>>17; dcetBlock[row] [5]=(x@*r2)>>17; 

} 

for (col=@;col<8;col+t+) { 
int x@=dctBlock[@] [col], x1=detBlock[1] [col], x2=dcetBlock[2] [col], 

x3=dctBlock[3] [col], x4=dcetBlock[4] [col], x5=dctBlock[5] [col], 
x6=dctBlock[6] [col], x7=dctBlock[7] [col], x8; 

/* Stage 1 */ 
x8=x/7t+x@; x@-=x7; x/7=x1+x6; x1-=x6; x6=x2+x5; x2-=x5; x5=x3+x4; x3-=x4; 
/* Stage 2 */ 
x4=x8tx5; x8-=x5; x5=x7+x6; x7-=x6; 
x6=c1%*(x1+x2); x2=(-si-c1)*x2+x6; x1=(s1-c1) *x1+x6; 
x6=c3* (x@+x3); x3=(-s3-c3)*x3+x6; xO=(s3-c3) *xOtx6; 
/* Stage 3 */ 
x6=x4tx5; x4-=x5; x5=x@0+x2;x@-=x2; x2=x3+x1; x3-=x1; 
xi1=r2c6*(x7+x8); x7=(-r2s6-r2c6) *x7+x1; x8=(r2s6-r2c6) *x8+x1; 
/* Stage 4 and output */ 
detBlock[@] [col]=(x6+16)>>5;  detBlock[4] [col]=(x4+16)>>5; 
dctBlock[2] [col] =(x8+16384)>>15; dcetBlock[6] [col] = (x7+16384)>>15; 
detBlock[7] [col] =(x2-x5+16384)>>15; dctBlock[1] [col]=(x2+x5+16384)>>15; 
dctBlock[3] [col] =((x3>>8) *r2+8192)>>14; 
detBlock[5] [col] =((x@>>8) *r2+8192)>>14; 

} 
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DR. ECCO’S OMNIHEURIST CORNER 


Trains for the Sultan 


Dennis E. Shasha 


t was unusual for Dr. Ecco to answer 

questions posed by four-year-old chil- 

dren, but that was what he was being 

asked to do. The mouthpiece, as it hap- 
pened, was the Sultan of Brunei. This gen- 
tleman, possibly the richest in the world, 
draws his wealth from a lake of oil that 
sits under his country’s jungle. His palaces 
dot the land, some larger than Versailles. 
His subjects pay no taxes, get free medi- 
cal care, and free television sets. Wealth 
has other privileges. | 

For example, the Sultan reportedly 
bought London’s Dorcester Hotel because 
he arrived unannounced one night and 
was told there were no rooms available. 
Purchasing the hotel has vastly improved 
his chances of getting a room on demand. 

During a recent visit to the United States, 
he asked Dr. Ecco to come to his suite at 
the Plaza Hotel to solve a design prob- 
lem. Ecco, in turn, asked Liane and me to 
come along. 

In spite of his wealth, the Sultan con- 
veyed an air of disarming informality. He 
did not remark on our casual clothes or 
the fact that we were three instead of one, 
seeming to be well aware of our working 
style. Wanting at once to dispel any feel- 
ing of unequal status, he stood up and 
shook our hands when we entered. Tea 
was served to all. 

We sat around an elegant antique desk 
in equally comfortable chairs. His secre- 
tary of protocol had requested only one 
favor from Ecco when he called to invite 
him: “Please let the Sultan ask all the ques- 
tions. Commoners are not to ask ques- 
tions of royalty, even honored common- 
ers like yourself.” 

With that admonition in mind, we wait- 
ed for the Sultan to begin the conversa- 
tion. The Sultan approached the problem 
indirectly. 


Dennis, a professor of computer science at 
New York University, is the author of The 
Puzzling Adventures of Dr. Ecco (Dover, 
1998), Codes, Puzzles, and Conspiracy 
(W.H. Freeman & Co., 1992), Database 
Tuning: A Principled Approach (Prentice 
Hall, 1992), and (coauthored with Cathy 
Lazere) Out of Their Minds: The Lives and 
Discoveries of 15 Great Computer Scien- 
tists (Springer Verlag, 1998). He can be 
contacted at DrEcco@ddj.com. 
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“As this young lady will certainly ap- 
preciate,” said the Sultan pointing to Liane, 
“children can come to a nearly fanatical 
early fascination with objects. So it is with 
my four-year-old son Hasan. He has a fine 
collection of electric trains, which he plays 
with for hours on end— a concentration 
befitting a much older child. He memo- 
rizes train maps and has his governess 
quiz him on them. He looks at my fleet 
of Rolls Royces with disdain, preferring 
the Da-Da-Da-Dun of rolling stock. 

“Two weeks ago, he put the question 
to me this way: ‘Father, why are there so 
many more cars than trains?’ I thought 
about this awhile and then responded, 
‘Because cars go wherever you ask them 
to, whenever you ask them to. Trains have 
fixed routes on fixed schedules.’ Hasan 
fell silent. A day later, though, he came 
back to me: ‘Father, in our beloved Brunei, 
if we built tracks where we now have 
roads, then trains would be able to go to 
most places where cars go. That elimi- 
nates the problem of fixed routes. As for 
the problem of fixed schedules, we could 
make the trains come at our demand.” 

“He’s very smart for a four-year-old,” 
Liane said appreciatively. 

The Sultan nodded and smiled. He then 
raised his index finger and more tea was 
served. 

“Little Hasan is also single-minded,” the 
Sultan continued. “He has mapped out 
the routes among the seven principal pop- 
ulation centers of Brunei. The names are 
difficult for westerners to pronounce, so 
I have designated them with letters for 
you. The letter B represents our down- 
town and the letter E represents a princi- 
pal recreational area.” 

The three of us studied the Sultan’s map 
(see Figure 1). 

“My engineers suggest a light rail sys- 
tem where each train has three cars and 
can carry 50 people in the comfort they 
are accustomed to. They have designed 
the system so it takes 15 minutes to tra- 
verse a leg from one station to its neigh- 
bor. Each train station will have room for 
two trains, but there will be only one track 
between stations. The engineers say that 
there is no justification for more tracks. 
Several trains can go on the same track 
provided they are going in the same di- 
rection. 





“Little Hasan, on the other hand, wants 
every passenger to get to his or her des- 
tination without changing trains and by 
one of the shortest paths possible. Fur- 
ther, he wants to be sure that even at times 
of peak demand, passengers can get to 
their destinations quickly. 

“Here is the demand at rush hour: 


150 want to go from A to F 
100 want to go from B to E 
50 from C to G 

150 from C to D 

150 from D to C 

100 from E to B 

50 from E to D 

50 from F to C 

50 from F to A 

50 from G to A 


“Can you, Dr. Ecco, ensure that every- 
one arrives at his or her destination as fast 
as possible, given that,” the Sultan put on 
his reading glasses and summarized, “there 
is initially a train at each destination, each 
leg takes 15 minutes, there is only one 
track between stations, trains can take only 
50 people at a time, no passenger needs 
to switch trains, and no passenger spends 
more time once on a train than the min- 
imum time necessary?” 


Reader: Please have a try. 


Liane and Ecco began working imme- 
diately. After several minutes, they pre- 
sented a schedule and train routing to the 
Sultan in which the latest passenger ar- 
rived at his or her destination after 105 
minutes. 

The Sultan nodded. “That is very good, 
but I think Hasan will not be pleased,” he 
said. “It’s just too much time. Is there any 
engineering change that would lead to a 
faster solution?” 

“If you convert five of your trains to car- 
ry 150 people instead of 50, allow station 
B to hold four trains instead of two, buy 
one more 50 person train, and allow me 
to change the starting position of one of 
the existing trains, then we can get ev- 
eryone to his or her destination in 45 min- 
utes,” Liane volunteered. 

“Please tell me how,” the Sultan said. 


keader: Can you match Liane’s achieve- 


ment or find a more efficient way? More 
efficient means either reducing the station 
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size of B or the train size of at least some 
of the trains. 


After she presented her solution, the 
Sultan beamed. He snapped his fingers 
and a servant arrived with a glistening di- 
amond necklace. “For a future occasion,” 
he said to Liane as he presented it to her. 





Figure 1: Train stations of Brunei. 
Each letter represents a train station. 
Line segments represent single tracks 
that trains can traverse in either 
direction, though only one direction 
at a time. Each line segment takes 15 
minutes to traverse. Initially, there is 
one train in each station, though there 
is room for two. The time for 
passengers to get on/off a train is 
negligible compared to travel time. 


Last Month’s Solution 
1. If every subset is possible, the total 
number of nonempty subsets of 7 ele- 
ments is 2”—1. Each of these must have 
a unique sum. If m=12, then 2”—1=4095. 
2. Labeling for 12 items but sets of size 3 
or less: 


1 2 48 15 28 52 96 105 278 460 663. 


The biggest sum is 278+ 460+ 663=1401. 
3. Labeling for 12 items but sets of size 4 
or less: 


1248 16 31 60 116 224 432 805 1494. 


The biggest sum is 224+ 432+805+ 
1494=2955. 


Reader Solutions to Subway 
Several readers told me they thought the 
Subway puzzle (DDJ, December 1998) 
was too easy. Naturally, I apologized. 
When writing this column, I realized that 
at least some respondents had simplified 
the problem by assuming that there is a 
train ready to depart at every station at 
every moment. (That simplification makes 
the problem beyond easy!) Another sim- 
plification was to ignore the time to 
switch trains. 

Still, hats off to those readers who beat 
Dr. Ecco in their answers to the first two 
problems. The first such correct answer I 


received was from Alan E. Dragoo, who 
proposed a method for dropping 13 stinky 
postcards off in 140 minutes after getting 
some extra sleep (and, ominously, acting 
closer to rush hour): 


A nasty person can drop postcards at 13 
stations in 140 minutes by boarding the spe- 
cial train at station (2,4) at 7:40, arriving at 
(0,0) at 8:30. He/she then boards the east- 
bound train at 8:40 and disembarks at (0,3) 
at 9:10. Finally, she/he boards the south- 
bound train at 9:20 and arrives at (4,3) at 
10:00. I know of no solution that works 
(without the above simplifications) when 
the poster begins at 6M. 


Alan also sent in one of many good 19 
station/240 minute solutions: 


Starting at (0,0) at 6:00, he/she takes the 
special train to (2,4) at 6:50; takes the 7:00 
westbound train to (2,1) at 7:30; switches 
to the northbound train at 7:40, arriving at 
(0,1) at 8:00; 8:10 east to (0,3) at 8:30; 8:40 
south to (4,3) at 9:20; and 9:30 west to (4,0) 
at 10:00. 


Others who found a way to deliver 
postcards to 19 stations in 240 minutes in- 
clude Tom Dinger, Tamas L. Visegrady, B 
Hoffrichter, Charles Taylor, and Joe Straitiff. 
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PROGRAMMER’S BOOKSHELF 


Taking a Risk 


Jonathan Amsterdam 


eople are understandably curious 

about the lives of authors— you can’t 

help but wonder what about Stephen 

King’s childhood led him to write such 
macabre tales, for instance. But when it 
comes to computer scientists, we don’t look 
any further than their work. That, too, is 
understandable. After all, the structure of 
a programming language doesn’t suggest 
many questions about its designer. 

So, a book such as Out of Their Minds 
is all the more welcome. In clear, non- 
technical prose, DDJ contributing editor 
Dennis Shasha and Cathy Lazere provide 
synopses of the lives and work of 15 of 
the greatest living computer scientists. 
Some are relatively well-known luminar- 
ies like Alan Kay, whose vision of a 
portable computer for children influenced 
a generation of computer designers and 
led indirectly to the Macintosh; or Don- 
ald Knuth, whose TeX typesetting system 
and three-volume book on algorithms are 
staples in computer-science departments. 
Others, like Michael Rabin and Doug 


Lenat, are not well known outside their | 


respective subfields. All have made major 
contributions to computer science. 

Each chapter begins with a brief intro- 
duction to the subject’s work, provides a 
biographical sketch, then explains the 
technical contributions. The authors’s ex- 
planations are interleaved with comments 
from the subject himself, gleaned from in- 
terviews. Technical details that might dis- 
tract the unprepared reader are thought- 
fully relegated to sidebars. 


Jonathan is founder and president of As- 
trel, a Java training and consulting firm. 
He also teaches programming at New 
York University. He can be reached at 
amsterdam @astrel.com. 
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Saasha a Pamere aonende with a 
summary of the characteristics exhibited 
by their subjects. Interests in music and 
biology are fairly common, and while ear- 
ly academic success was not universal, 
eventually all of the researchers found 
mentors at top-quality institutions. Another 
commonality is that all the book’s subjects 
are male; unfortunately, women are only 
just beginning to make a mark in com- 
puter science. 

Nontechnical readers will come away 
from Out of Their Minds with a better 
sense of computer science, learning about 
such topics as complexity theory, hard- 
ware design, and artificial intelligence. 
Even those with a background in the field 
are likely to learn something new, so 
broad is the book’s scope. And everyone 
will enjoy the book for the glimpses it pro- 
vides into the personal lives and beliefs 
of some of the giants of the discipline. For 
instance, many programmers know that 
John Backus invented Fortran, but few re- 
alize that he barely made it through high 
school and flunked out in his first attempt 
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at college. That and other fascinating de- 
tails, technical and otherwise, make this 
book well worth reading. 

It is by now a truism that every tech- 
nology is a double-edged sword, creating 
new problems even as it solves old ones. 
Computers are no different, but because 
of their complexity, their ubiquity, and 
their interconnectedness with so many 
other technologies, computer risks are 
greater in degree. Not only are the po- 
tential problems more severe, but they 
come in so many different varieties that 
even classification seems daunting. 

Peter Neumann has taken up the chal- 
lenge of classifying and analyzing these 
problems in his book Computer-Related 
Risks. Neumann, a researcher at SRI In- 
ternational, runs the Risks Forum Inter- 
net newsgroup as a kind of sideline, and 
writes the “Inside Risks” column for 
Communications of the ACM. His book 
divides roughly into two sections. The 
first is a collection of problems and dis- 
asters, drawn mostly from the Risks Fo- 
rum and classified according to the type 
of problem — reliability, safety, security, 
and so on. The second part of the book 
is a more general analysis of risk in com- 
puter systems, along with some recom- 
mendations for avoiding problems in the 
future. 

Neumann’s analysis of risk has its in- 
teresting parts, particularly a careful and 
sobering discussion about the trade-offs 
involved in implementing a computer- 
ized voting system. He points out the in- 
evitable inconsistencies in designing a 
system that respects the privacy of a vot- 
er’s choices, but is also immune to 
fraud— which would seem to require 
the ability to inspect individual voting 
records. But at many places in the latter 
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half of the book, Neumann’s prose bogs 
down in generalities and abstractions. 
Sentences like, “Of particular interest here 
are the problems of addressing the dif- 
ferent requirements, observing the most 
useful principles, and developing robust 
systems that can dependably and simul- 
taneously satisfy all of the requirements, 
including when operating under recov- 
ery and other emergency conditions” 
marshal a great many words in service 
of the obvious. 

The greatest pleasure in this book is 
gleaned in the first half, with its rich col- 
lection of risk anecdotes. Here, Neumann 
is more concise and concrete, even fun- 
ny at times. While some of the events are 
true catastrophes— Chernobyl, for in- 
stance, or the shooting down of an Irani- 
an passenger plane by the USS Vin- 
cennes— others have a Keystone Kops 
quality at which you can’t help but smile. 
One of my favorites is the 1986 ARPAnet 
outage. (The ARPAnet, funded by the De- 
partment Of Defense’s Advanced Research 
Projects Agency, was the precursor of the 
Internet.) In Neumann’s words: 


Reliability concerns dictated that logical re- 
dundancy should be used to ensure alter- 
nate paths between the New England 
ARPAnet sites and the rest of the ARPAnet. 


Thus, seven separate circuit links were es- 
tablished. Unfortunately, all of them were 
routed through the same fiber-optic cable, 
which was accidentally severed near White 
Plains, New York, on December 12, 1986. 


Everyone will enjoy 
Out of Their Minds 
for the glimpses it 
provides into the 
personal lives and 
beliefs of some of 
the giants of the 
discipline 


This story teaches the importance of 
having redundancy at all levels more ef- 
fectively than any abstract statement of the 
same principle. 


Taken as a whole, the risk anecdotes 
make it clear that there is no single clause 
or even small set of causes responsible 
for problems, and thus, no easy solutions. 
Certainly, technology will not save us 
from itself. We who use modern pro- 
gramming languages can smile at stories 
of spacecraft gone awry because of a mis- 
placed comma and feel confident it won't 
happen again, but the vast majority of 
disasters suggest no easy fix. They arise 
from bizarre combinations of unforeseen 
events, systems operating in environments 
for which they were not designed, and 
human blunders that are often common- 
sense responses to poor design or un- 
usual circumstances. The moral of the 
story for system designers is to expect 
the unexpected and to consider careful- 
ly the system’s users, the context of use, 
and the effects of the system on the larg- 
er society. 

Neumann concludes by calling for a bal- 
anced view of technology— one that sees 
technology as an enabler of human po- 
tential rather than an infallible replacement 
for human foibles. Not every new tech- 
nology is an advance. For some, the risks 
outweigh the benefits. 
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© C-REF ($69) Creates cross-reference of local/global/define/parameter identifiers. 


¢ C-DOC ($199) PACKAGE All 5 programs integrated as DOS program. <10,000 
lines. C-BROWSE Windows graphic-tree viewer. 


¢ C-DOC Professional ($299) DOS, Windows, 0S/2, 1,000,000+ lines. 
¢ NEW VER 7.0! WEB HTML REPORTS! 


SOFTWARE BLACKSMITHS INC. email @ swbs.com 
6064 St Ives Way, Mississauga _— Voice/Fax (905) 858-4466 
ONT Canada L5N-4M1 http://www.swbs.com 
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Understand For C++ 


Analyzes your C++ source code to help you 
quickly understand your software. 


¢ Hypertext source & Class Browser 
* Detailed Interactive Cross Reference 


* Invocation, Include, Declaration Heirarchy Charts 
* HTML Publishing of Code & Analysis 


* WYSIWYG printing, Clipboard & Bitmap Output 


Download your 
eval copy today. SST 


wwwscitools.com Scientific Toolworks, Inc. 


Phone: (603) 298-5905 21 Technology Drive Ste #4 
Fax: (603) 298-5910 West Lebanon, NH 03784 
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OneRealm has begun shipping a software 
suite for internationalizing software. The 
suite consists of three components: i18n 
Expeditor, Organizer, and the Global En- 
capsulation Library (GEL). i18n Expeditor 
performs static source-code analysis, de- 
tecting and correcting a variety of inter- 
nationalization violations in source code. 
For errors that cannot be corrected auto- 
matically, the tool provides problem- 
specific advice. Organizer is an informa- 
tion repository that automatically keeps 
track of project files and the status of 
internationalization-related decisions and 
changes made to the source code. GEL 
provides a collection of ready-to-use, high- 
level components for functions such as 
text literals, date, time, and currency, that 
are fully internationalized and platform- 
independent. i18n Expeditor costs $1250.00 
for a single seat and includes either C/C++ 
or Java support. Additional language sup- 
port is available for $050.00. GEL is avail- 
able for $650.00 a seat. 

OneRealm Inc. 

4810 Riverbend Road 

Boulder, CO 80301 

303-247-1284 

http://www.onrealm.com/ 


FairCom has released c-tree Plus v6.8A, 
the most recent release of its C ISAM 
database API. This release offers flexible 
file limits, enhanced file mirroring, an en- 
hanced data history function, and an im- 
proved portable multithreaded client API. c-tree 
Plus v6.8A now supports FreeBSD, UnixWare, 
Irix, and AIX, in addition to the 25 other plat- 
forms it previously supported. c-tree Plus v6.8A 
costs $895.00, includes the C source code, and 
is royalty free. 

FairCom Corp. 

2100 Forum, Suite C 

Columbia, MO 65203 

573-445-6833 

http://www .faircom.com/ 


Objective Interface Systems has announced 


ORBexpress Real-Time for C++, a low- 
latency implementation of a CORBA 2.2 
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object request broker (ORB) that has been 
extended to support real-time require- 
ments. ORBexpress offers full ITOP sup- 
port and incorporates an architecture that 
lets you replace key components of the 
ORB itself. The ORBexpress Resource Al- 
location Control Environment lets you 
manage the impact of finite resource ca- 
pacity on service quality. The internal al- 
gorithms were designed to minimize and 
bind priority inversions, and ceiling lock- 
ing protocols are applied where appro- 
priate to avoid deadlocks. 

Objective Interface Systems Inc. 

1892 Preston White Drive 

Reston, VA 20191 

703-295-6500 

http://www.ois.com/ 


Microstate has announced that Hamilton, 
its thin-client, cross-platform, database- 
driven web application server based on 
Java, is now available as open-source soft- 
ware, freely accessible over the Internet. 
Hamilton interacts with the web server us- 
ing the Java servlet model. 

Microstate Corp. 

11166 Main Street, Suite 100 

Fairfax, VA 22030 

703-591-9797 
http://microstate.com/tech.htm 


Becker & Mohnberg Software has released 
two new JavaBean components: b+m 
Print-Bean, which adds printing and print 
preview functionality to your Java appli- 
cations; and b+m Chart-Bean, which can 
be used to visualize data from a database 
or table object using two- or three-di- 
mensional charts. The cost of each pack- 
age is $895.00 with source code, $295.00 
without. 

Becker & Mohnberg 
Herzog-Friedrich-Strasse 91 

D-24103 Kiel, Germany 
http://www.bmsg.de/ 


Model EyeQ is a modeling and docu- 
mentation tool from Synergex that lets you 
produce software-design documentation 
in several formats, including Microsoft 
Word, Microsoft PowerPoint, HTML, and 
plain text. Model EyeQ provides a set of 
templates that allow you to begin gener- 
ating documentation immediately. Model 
EyeQ provides full support for Rational 
Rose and Microsoft Visual Modeler. It is 
currently available for Windows NT/95/98. 
Synergex 

2330 Gold Meadow Way 

Gold River, CA 95670 

916-635-7300 


http://www.synergex.com/ 


Emultek’s Rapid PLUS. suite of simulation 
tools now includes voice and handwrit- 





ing technologies. According to Emultek, 
Rapid PLUS is the first simulation software 
for embedded-systems development that 
supports handwriting and voice recogni- 
tion, which is based on Advanced Recog- 
nition Technologies’s smARTspeak voice 
recognition and smARTwriter handwriting 
recognition. smARTspeak learns the users 
voice, regardless of language or accent, 
and uses a patented noise-filtering algo- 
rithm to refine voice input in noisy envi- 
ronments. smARTwriter handwriting recog- 
nition is based on shape recognition 
technologies, and supports many lan- 
guages or a combination of languages. 
smARTwriter also supports unlimited 
macro and application launching. 
Emultek Inc. 

301 North Lake Avenue, Suite 1002 
Pasadena, Ca 91101 

626-584-7810 

http://www.emultek.com/ 


Genitor has announced three new config- 
urations of Genitor v4.0: Surveyor, Object 
Construction Suite (OCS), and Corporate 
Edition. Genitor Surveyor analyzes preex- 
isting C/C++ source code and generates a 
web site containing detailed documenta- 
tion and class hierarchy charts. The most 
recent version of Genitor OCS provides 
new features such as pattern wizards and 
improved integration with Microsoft De- 
veloper Studio. Genitor Corporate Edition 
combines features in Surveyor and OCS 
with improved legacy code reengineering. 
The Genitor tools run on Windows 
95/98/NT, and are available in single-user 
and multiuser configurations. 

Genitor Corp. 

220 East Huron, Suite 500 

Ann Arbor, MI 48104 

734-213-2500 

http://www.genitor.com/ 


Softway Systems’s Interix Release 2.2 is a 
UNIX system that runs as a subsystem of 
the Windows NT kernel. Interix Release 
2.2 includes X, Apache, fully integrated 
support for intended, Internet daemons 
and clients, subsystem support for inter- 
val timers and additional processes, en- 
hanced SVID IPC performance, integra- 
tion with Win32-shared memory, and 
integration with Winsock 2.2. 

Softway Systems’s Interix Professional 
SDK is also available. Interix Profession- 
al SDK provides all of the tools, libraries, 
and header files necessary for developers 
to port UNIX applications natively to Win- 
dows NT using no emulation or run-time 
interpretation. The SDK contains POSIX.1, 
POSIX.2, and ANSI C interfaces, integra- 
tion with the Microsoft C compiler devel- 
opment environment, ODBC database li- 
braries, OpenGL libraries, an ISV kit for 
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generating stand-alone Interix products, 
Motif libraries, sockets, IPC, shared mem- 
ory, color curses support, X11R35 libraries, 
and a number of GNU tools for compil- 
ing and debugging applications. Interix 
Professional SDK costs $1999.00. 
Softway Systems Inc. 

185 Berry Street, Suite 5514 

San Francisco, CA 94107 

415-896-0708 

http://www. interix.com/ 


Black Ice Software has released a new Col- 
or Print Driver for Windows 95/98. The 
Color Driver outputs 8-bit color, 8-bit 
grayscale, and 24-bit TIFF or JPEG format. 
It uses a device-independent, color space, 
L*a*b Color Space Format. The color driv- 
er is capable of writing in many file for- 
mats, including JPEG, PCX, DCX, DIB, and 
TIFF. Over 42 different page sizes are sup- 
ported. Every GDI drawing function is sup- 
ported, as well as Adobe and TrueType 
fonts. Black Ice also offers a Color Print 
Driver for Windows NT 4.0, which includes 
an NT Resource Kit. The Resource Kit con- 
sists of tools to speed up the process of 
integrating the NT driver with custom ap- 
plications. The Windows 95/98 and NT 4.0 
Color Drivers are compatible with Bicom, 
Brooktrout, Dialogic, Commetrex, and Nat- 
ural Microsystems fax boards. 

Black Ice Software Inc. 

292 Route 101 

Amherst, NH 03031 

603-673-1019 

http://www.blackice.com/ 


Logic Programming Associates has begun 
shipping the most recent version of LPA 
Prolog for Windows, an application de- 
velopment environment for building Pro- 
log programs for Windows. This release 
features Y2K compliance, extended file 
handling and buffer routines, enhanced 
graphical debugger, and support for mul- 
tiple Prolog engines. Prices for Prolog 
range from $145.00 for a personal edition 
to $995.00 for a developer edition, which 
includes the stand-alone application gen- 
erator and royalty-free run-time distribu- 
tion license. Toolkits cost extra. 

Logic Programming Associates Ltd. 
Studio 4, R.V.P.B., Trinity Road 

London, SW18 3SX, England 

+44 181 871 2016 
http://www.lpa.co.uk/ 


ComponentSource has announced its 
01/99 Multipack Library CD, a 3-CD set 
that contains over 1200 business compo- 
nents and technical material. It is freely 
available by registering at the Compo- 
nentSource web site. ComponentSource 
has also announced its Source Code Es- 
crow Service, aimed at increasing the 
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adoption of component usage for corpo- 
rate businesses. The service entails pre- 
packaged component vendors depositing 
their source code with ComponentSource, 
who then acts as the escrow agent. The 
escrow price to developers for the service 
will vary from product to product. Each 
escrow agreement will be available for re- 
newal on an annual basis. 
ComponentSource 

2878 Johnson Ferry Road, #150 

Marietta, GA 30062 
http://www.componentsource.com/ 


Certicom’s SSL Plus for the Palm Com- 
puting Platform is a Secure Sockets Lay- 
er (SSL) protocol toolkit. You can use SSL 
Plus to build a secure Internet channel to 
enterprise applications from Palm hand- 
held computers using Certicom’s elliptic 
curve cryptography. 

Certicom Corp. 

200 Matheson Boulevard W 

Mississauga, ON 

Canada L5R 3L7 

905-507-4220 

http://www.certicom.com/ 


Harmony Software has introduced a suite 
of data models that provide the architec- 
tural blueprint for mapping the data ele- 
ments and data interrelationships required 
for developing integrated datamarts and 
analytical applications. Harmony data 
models are available for 23 industries, in- 
cluding banking, finance, pharmaceutical 
and retail; and 31 business functions, in- 
cluding manufacturing, inventory, human 
resources, and finance. The models can 
be used by any CASE tool to generate 
database schemata that can be immedi- 
ately populated with data. 

Harmony Software Inc. 

107 South B Street 

San Mateo, CA 94401 

650-696-9580 
http://www.harmony.com/ 


Force 5 Software has announced Version 
2.6 of JCloak, its Java obfuscator. JCloak 
protects Java bytecode from reverse engi- 
neering by reducing the symbol informa- 
tion stored in Java class files. JCloak sup- 
ports JDK 1.2 and reduces applet size up 
to 30 percent. 

Force 5 Software Inc. 

839 Lewis Avenue 

Sunnyvale, CA 94086 
http://www.force5.com/ 


O’Reilly & Associates has announced that 
Java/Perl Lingo (JPL), software that lets you 
integrate Perl and Java source code, is now 
freely available as open source software. 
JPL enables programmers to implement 
Java methods with Perl, and for Perl code 
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to access Java via the Java Native Interface 
(QJND. It includes a translator and build sys- 
tem that make it easy to create JPL appli- 
cations. JPL was developed by Perl creator 
Larry Wall, and is available as part of the 
latest development release of Perl. 
O’Reilly & Associates 

101 Morris Street 

Sebastopol, CA 95472 

707-829-0515 

http://www.perl.com/ 


Ives Development’s Server Edition of Team- 
Studio CIAO! is a tool that provides check- 
in/check-out and version control for Lotus 
Notes and Domino database designs. Team- 
Studio CIAO! Server Edition is an optional 
add on to the standard Client Edition. Serv- 
er Edition runs on a Domino server, and 
protects a database design from being up- 
dated by anyone other than the person who 
has the affected element checked out or 
locked. TeamStudio CIAO! Server Edition is 
priced at $1475.00 per Domino server, 
which includes one year’s maintenance and 
unlimited technical support. 

Ives Development Inc. 

900 Cummings Center, Suite 326T 
Beverly, MA 01915 

978-232-0145 
http://www.teamstudio.com/ 


Fluid3D from OZ.COM is a tool for the de- 
velopment and deployment of broadcast 
quality, streaming 3D animation across the 
Internet using RealNetworks RealPlayer 
G2. The Fluid3D plug-in for the G2 play- 
er is small (350 KB) and freely available. 
Fluid3D uses a compression scheme for 
animation data that is optimized for stream- 
ing delivery over low-bandwidth connec- 
tions. Combined with SMIL-based media 
type synchronization provided by Real- 
System G2, long-form 3D animation with 
synchronized RealAudio is possible. Flu- 
id3D Content Exporters enable 3D ani- 
mation created in industry-standard 3-D 
authoring tools, such as Kinetix 3D Studio 
MAX and Avid SOFTIMAGE | 3D, to be 
saved directly to Fluid3D’s binary file for- 
mat. Fluid3D for RealPlayer G2 is current- 
ly available for Windows 95/98/NT. Fluid 
3D for 3D Studio Max is available for Win- 
dows 95/98/NT, and Fluid 3D for SOFT- 
IMAGE | 3D is available for NT and Irix. 
OZ.COM 

525 Brannan Street, 4th Floor 

San Francisco, CA 94107 

415-536-0500 


http://www.oz.com/ 
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SWAINE’S FLAMES 


The Creative Process 


don’t know if you realize the effort that I go through to bring you the finest in column material 
| every month. Just so you'll appreciate what I do for you, here are the ideas for columns that I 
rejected this month. 

Column Idea 1—Party Games and Company Names. With the large number of technology 
companies that have selected common words for their names, you could make a party game 
out of trying to construct meaningful sentences entirely from tech company names. For exam- 
ple, “Be On Time Now, Lotus. iShip On Digital River. Go Intuit, Cisco. Yahoo!” 

Sorta reminds me of the party game where you combine the names of two people who have 
nothing in common but their last name and wish them a happy anniversary: “Happy anniversary, 
Ken and Brenda Starr...George and Kate Bush...Klaus and Malibu Barbie...Windows and Year 2000. 

Maybe we don’t go to the same parties. Speaking of company names, I’ve written a business plan 
for the ultimate corporation, B and M Enterprises. That stands for “Branding and Merchandising.” 
It produces no product, delivers no service, just develops a strong brand identification and licens- 
es it to a T-shirt company. And not just a T-shirt company, either. Every strong brand deserves 
a line of T-shirts, baseball caps, iron-on patches, pens, action figures, trading cards, refrigerator 
magnets, calendars, mouse pads, lunch boxes, ceramic mugs, plastic glasses, bumper stickers, but- 
tons, decals, temporary tattoos, permanent tattoos, graffiti. You name it. Which reminds me of... 

Column Idea 2—Short (But Not Short Enough) Haiku. 


What did the Buddhist 
order at the game? Make me 
one with everything. 


I Got Dem Termination-of-Project Blues 
I’m What It Is — until it isn’t. 
I wuz da Wiz, but now I’m wizened. 


Column Idea 3—Assigning Blame. The Annals of Improbable Research asks the crucial Y2K ques- 
tion: Who can we blame? Let's assign blame, hold an execution, and move on, they say. Apparently 
a vote of censure wouldn’t suffice. Vanity Fair gets an answer to the question from former Depart- 
ment of Defense coder Harry White, who says we should blame the DOD. They were too “occupied 
with Vietnam” and couldn’t be bothered to listen to his warnings. His buddy Bob Bemer makes a 
fine case for blaming it all on Nixon. Two excellent fall guys, in my opinion, but I blame Jesus Christ. 
When I start to explain the Jesus-Y2K connection, though, people tell me, “Get a life, Fox.” That’s a 
reference to— oh, you know what that’s a reference to. 

Or we could just blame Alan Greenspan, who, long before becoming Federal Reserve 
Chairman, was one of those 2-byte programmers. This plan has the advantage that the accused 
has already confessed. “I’m one of the culprits who created this problem,” Greenspan told 
Congress a few months back. Let’s lay it all on him. 

Column Idea 4— Didja Ever Wonder. Were there moments in the Microsoft antitrust trial when you 
thought Bill Gates might bomb Iraq to draw some heat off himself? 

In a few years will we be looking back on the good old days when you didn’t have to think about 
what operating system you were going to run on your computer? 

Will there come a day when we yearn for the simplicity of Windows registry files? Given the 
negative connotations of the year 2000, was Windows 2000 really a wise name choice? 

Didja ever notice how the Internet has brought people together so that they can more 
effectively isolate themselves? Little circles of users use technical jargon and acronyms to shut 
others out of their groups. Chatroom denizens refer to their offline life as IRL (“in real life”). 
Online computer gamers talk about NPCs (“nonplayer characters”). 

IRL, I’m an NPC. 


Habad Sead 


Michael Swaine 
editor-at-large 
mswaine@swaine.com 
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Loaded with 
features... 


Multi - Language 
CodeBase 6.4 works with C, C++, Visual Basic, Delphi, ODBC 
and OLE DB. 








Incredible Speed 

Query a million records in 0.49 seconds. Append 10,000 
records in just 0.65 seconds! All this speed in a super- 
compact library that uses very little memory. 





Royalty Free 


Includes standalone, client and server. 








xBASE Compatible 


Multi-user file compatible with FoxPro, dBASE and Clipper 
data, index and memo files. 





Client/Server 

Advanced security features. New easy-to-use tools for 
monitoring database activity and managing user access. 
Incredibly easy installation and setup! 








Portable 
Runs under Windows 98, 95, NT, CE, 3.1, DOS, Mac, 05/2, Solaris, 
Sun08, AIX, SCO, Linux, UnixWare, DEC, Alpha, BSDI, HP/UX... 





Enterprise-Level Power 
Includes transaction processing, logging, backup and recovery 
tools, and intelligent queries. 








VERSION : 
For. CH, Vinal Ba nd Dei Pen 6 Data-Aware controls, full-featured report writer and free 
ile compatible with dBASE. FoxPro and Clipper : 


technical support. Add-ons available for OLE DB, ODBC and 
Delphi BDE plug-in replacement. 





FREE 30 Day Test Drive 


Test drive the new CodeBase 6.4 for 30 days 
with your own code. No risk. No obligation. 
No royalties. Order today! 


Call: 403-437-2410 


Web Site: www.sequiter.com 


“CodeBase gives ACT! the fast database access 
that contact management users need.” 
- Michael Plasterer, Director of Development, Symantec 
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SSSSS SEQUITER|| 


Award-Winning performance 5 years in a row! 
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Fax: 403-436-2999 Email: info@sequiter.com 


- © 1998 Sequiter Software Inc. All rights reserved. CodeBase and Sequiter are registered trademarks of Sequiter Software Inc. P.O. Box 783, Greenland, NH 
All other product names are trademarks of their respective companies. In Europe call: (44) 181-316-5001 





powerful productivity features: 
Two-way drag and drop programming environment 
Superior JFC/Swing support with native compilation 


= Visual 


‘THE FASTESE JAUA. DEVELOPMENT ‘SOLUTION FOR CORPORATE DATABASES 


ORACLE 


The next generation of the #1 selling Java IDE. BS 4QY/-WWeete 





